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PREFACE 


The  Department  of  Defense  and  the  Air  Force  have  always  recog¬ 
nized  the  need  to  insist  on  top  quality  in  the  wide  variety  of 
material  that  is  purchased  in  support  of  the  fighting  forces. 
Recently,  as  part  of  the  emphasis  being  placed  on  contractors  and 
their  actions  relative  to  providing  quality  products,  visibility 
into  the  actual  Cost  of  Quality  has  become  very  important. 

The  concept  of  Cost  of  Quality  cuts  across  all  functional  activi¬ 
ties  involved  in  the  development  and  acquisition  of  weapon  sys¬ 
tems,  related  spares,  and  support  equipment.  Making  Cost  of 
Quality  visible  is  important  because  it  will  highlight  areas 
where  it  is  obvious  that  contractors  are  trying  to  inspect  or 
test  quality  in,  rather  than  build  it  in.  Seeing  where  contrac¬ 
tors  are  experiencing  excessive  costs  (for  example,  in  inspec¬ 
tion,  test,  reinspection,  retest,  engineering  changes,  material, 
labor,  return  to  vendor,  etc.)  will  enable  government  and  con¬ 
tractor  personnel  to  focus  on  efforts  to  find  the  root  causes  for 
these  costs  and  to  eliminate  those  causes. 


This  handbook  was  developed  for  two  purposes.  First,  the  hand¬ 
book  explains  the  concept  of  Cost  of  Quality  in  its  basic  form 
and  in  terms  of  the  major  categories  of  costs  involved.  Second, 
the  handbook  deals  with  the  specific  aspects  of  Cost  of  Quality 
involved  with  individual  areas  of  expertise.  Users  are  shown  how 
to  identify  and  evaluate  Cost  of  Quality  elements  in  their  parti¬ 
cular  discipline.  Once  captured,  Cost  of  Quality  provides  a 
vehicle  for  good  multifunctional  communication.  Each  function 
can  relate  to  quality  issues  that  cut  across  several  functional 
lines.  In  this  way,  feedback  is  provided  on  common  problems  and 
effectiveness  of  solutions.  Overall,  the  handbook  will  help  the 
user  to  work  with  the  contractor  in  the  identification,  evalu¬ 
ation,  and  management  of  Cost  of  Quality. 


A  word  of  caution.  The  handbook  is  not  a  "cookbook"  or  a  "check¬ 
list".  Rather,  it  is  a  guide  intended  to  educate  and  enable  the 
user  to  think  about  Cost  of  Quality,  understand  it,  and  ask  the 
right  kinds  of  questions  in  order  to  find  the  cost.  Once  found, 


use  of  the  cost  data  as  a  management  tool  then  becomes  the  main 
thirust.  The  handbook  is  not  meant  to  stand  alone.  Rather,  the 
visibility  into  Cost  of  Quality  that  can  be  gained  by  using  the 
principles  provided  in  the  handbook  must  be  related  to  other 
contractual  requirements,  especially  MIL-Q-9858A,  MIL-STD-1535A, 
and  MIL-STD-1520C,  to  maximize  the  total  effectiveness  of  what 
the  government  and  contractor  can  and  must  do  to  ensure  that  the 
highest  quality  products  reach  the  users  in  the  field. 


Avdil.i  ^i.ty  Cadts 


i  Adjii  d.-j/or 
Dist  S'  c'Cldl 
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INTRODUCTION/OVERVIEW 


The  ^geel^  purpose  of  the  handbook  Is  to  function  as  an  aid  to  the 
understanding  of  the  concept  of  cost  of  quality  and  its  value  as  a 
management  tool.  Individuals  who  are  not  a  part  of  a  quality 
assurance  organization  must  recognize  that  there  are  activities  which 
go  on  in  their  area  of  interest  that  are  indeed  part  of  the  total 
cost  of  quality  for  an  organization. \  Most  importantly,  the  use  of 
the  cost  of  quality  information  as  ^n  aid  in  identifying  problem 
areas  and  eliminating  problem  root  causefi  across  all  functional  areas 
is  the  real  purpose  of  capturing  the  1  cost  of  quality  in  the  first 
place.  The  handbook  will  enable  all  functional  personnel  to 
understand  cost  of  quality,  find  the  dost  in  their  area,  and  judge 
its  use  as  an  effective  tool  for  identifying  and  eliminating 
problems .  / 

/ 

Proper  use  of  this  handbook  requires  ifhat  Chapters  one  through  three 
be  studied  in  their  entirety  so  ^hat  the  user  can  gain  a  clear 
understanding  of  the  basic  principles  underlying  the  concept  of  Cost 
of  Quality.  Specifically,  the  use^^ will  gain  an  understanding  of  the 
benefits  of  having  visibility  X^ito  the  Cost  of  Quality  and  how  cost 
of  quality  should  be  used  a^  a  management  tool.  Of  particular 
importance  is  the  recognition^hat  cost  of  quality  is  one  tool,  to  be 
integrated  with  other  tools^^uch  as  multidisciplined  problem  solving 
under  MiL-STD-1520C,  fo^xhe  purpose  of  reducing  and/or  eliminating 
when  possible,  the  gener^ion  of  nonconforming  material. 

After  absorbing  the  basic  information  in  Chapters  one  to  three,  users 
can  refer  to  ^ttte  section  in  Chapter  four  which  applies  to  their 
particular  ar^a  of  expertise.  Here  the  user  will  find  more  specific 
detail  oiv-Kow  to  determine  cost  of  quality  in  that  partiuclar  area  of 
intere^t<'^  The  user  will  be  shown  how  to  evaluate  the  cost,  and  how 
to ^<)l5dge  whether  or  not  the  contractor  is  effectively  using  cost  of 
qvrality  as  an  integral  and  effective  tool  for  finding  and  eliminating 
/Causes  of  defective  output.  The  term  output  is  used  here  because  the 
"product"  supplied  may  be  an  engineering  drawing,  a  purchase  order,  a 
contract  modification,  or  an  electronic  circuit  card. 

'-This  handbook  is  designed  to  be  used  by  people  involved  with  proposal 
evaluation,  fact  finding,  should  cost,  quality  audits,  contractor 
operation  reviews,  source  selection,  pre-award  surveys,  or  any  review 
effort  in  which  visibility  into  what  the  government  is  paying  for 
quality  would  be  useful.  All  disciplines  are  involved  in  these  types 
of  reviews  and  all  disciplines  have  a  share  in  the  cost  of  quality. 
The  quality  representative  involved  in  a  particular  review  would  be 
the  focal  point  for  overall  cost  of  quality  evaluation  results.  But 
each  of  the  other  team  members  must  find  the  cost  of  quality  in  their 
specific  area,  evaluate  the  cost,  and  make  input  to  the  quality 
representative  for  consolidation.  The  handbook  is  designed  to  enable 
each  participant  team  member  to  accomplish  that  task  in  support  of 
the  overall  cost  of  quality  effort. 
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As  mentioned,  the  handbook  Is  divided  Into  two  major  sections.  The 
first  section  (Chapters  one  through  three)  provides  the  tutorial 
needed  to  enzdsle  users  to  fully  understand  the  concept  of  the  cost  of 
quality,  what  it  means,  how  to  identify  it,  and  how  it  is  to  be  used 
in  analysis.  The  second  section  (Chapters  four  and  five)  provides 
specific  help  by  area  of  expertise  to  enable  users  to  apply  the 
principles  to  their  particular  area  of  interest.  Chapter  five  also 
provides  insight  into  methods  that  can  be  used  to  effectively 
implement  and  use  a  cost  of  quality  program. 


Before  discussing  the  concept  of  cost  of  quality,  it  is  necessary  to 
clearly  explain  the  true  nature  of  quality.  The  traditional  view  of 
quality  is  focused  on  the  following: 

Quality  is  the  responsibility  of  the  quality  department 

-  Quality  relates  only  to  the  goodness  of  the  final  product, 
i.e.,  the  products  finish,  its  dimensions,  its  power  output, 
its  operating  temperature,  etc. 

-  Manufacturing  is  the  biggest  contributor  to  lack  of  quality 
Improving  Quality  will  cost  more  money 

Quality  is  defined  by  the  manufacturer. 

Unfortunately,  much  of  what  many  people  believe  about  quality  is 
based  on  these  erroneous  ideas. 

Experts  in  the  quality  field  today  generally  recognize  that  rather 
than  the  traditional  ideas  the  real  essence  of  quality  is  that: 

Everyone  in  the  organization  contributes  to  the  ultimate 
quality  of  the  organization's  output.  Everyone  must  be 
responsible  for  their  contribution  to  that  quality. 

Quality  relates  to  everything  that  contributes  to  the  final 
output.  The  sales  person's  capturing  of  the  customer's 
requirements,  the  designer's  translation  of  those 
requirements  into  a  design  that  meets  the  requirements,  the 
purchasing  agent  who  buys  the  correct  material/parts,  the 
planner  who  translates  the  design  into  production  work 
instructions,  the  process  operator  who  follows  the 
instructions,  the  inspector/tester  who  audits  all  the  above 
"processes",  the  packing  and  crating  people  who  prep  the 
product  for  final  shipment  -  every  one  of  these  people  can 
and  does  contribute  to  the  ultimate  quality  of  the 
organization's  output,  and  to  the  cost  of  achieving  that 
quality. 

Anyone  described  above  can,  and  often  does,  contribute  to  a 
lack  of  quality.  Without  going  through  the  entire  list,  it 
should  be  obvious  that  failing  to  properly  perform  any  one 
or  more  of  the  functions  described  will  degrade  the  ability 
of  the  organization  to  effectively  and  efficiently  generate 
quality  output.  Note  the  emphasis  on  effectively  and 
efficiently. 


When  one  function  in  the  organization  has  to  "shore  up"  the 
lack  of  quality  in  one  of  its  sister  functions,  their 
remedial  actions  drive  up  costs.  Further,  the  potential  for 
actual  degradation  of  the  quality  of  the  final  product  is 
greatly  increased  because  errors  are  basically  being 
tolerated  and  will  ultimately  escape  the  system  and  effect 
the  product. 


Eliminating  errors  throughout  the  entire  organization 
improves  quality.  Work  done  to  find  and  correct  these 
errors  is  eliminated.  Costs  ao  down.  Non-value  added 
effort  can  now  be  channeled  into  value  generating  activity. 
Productivity  goes  up. 


The  customer  defines  quality.  The  customer  establishes  the 
rec[uirements .  Any  product  or  output  that  meets  the 

customers  requirements  and  expectations  will  be  judged  by 
that  customer  as  being  a  quality  product.  The  producer 
cannot  decide  what  is  a  quality  product  and  say  that  the 
customer  should  recognize  it  as  such.  If  that  product  does 
not  meet  the  customer's  requirements  and  expectations,  no 
matter  how  fancy  the  product  is  or  how  high  and  fast  it  will 
go,  it  is  not  a  quality  product.  Here,  it  is  necessary  to 
talk  about  internal  as  well  as  external  customers.  Everyone 
in  the  organization  has  customers  within  that  organization, 
or  internal  customers.  Each  of  these  internal  customers 
defines  the  quality  of  the  "products"  they  receive  from 
other  functions.  For  example,  manufacturing  needs  current, 
producible,  and  accurate  blueprints  from  design 
engineering.  Purchasing  needs  timely  material  requirements 
from  manufacturing,  and  product  specifications  from 
engineering,  and  quality  assurance.  Purchasing  is  both  a 
"customer  of"  these  functions,  as  well  as  having  them  "as 
customers"  of  the  results  of  the  purchasing  effort. 

Recognizing  that  everyone  in  every  function  has  a  role  in  determining 
quality,  and  that  finding  and  eliminating  causes  of  problems  will 
reduce  costs  and  improve  output  quality  is  the  essence  of  quality  and 
the  basis  for  using  cost  of  quality  as  an  effective  management  tool. 

The  fact  that  there  are  indeed  "costs  of  quality"  is  driven  by  the 
requirement  that  some  action  is  needed  to  ensure  that  the  various 
weapon  systems  and  components  bought  by  the  Air  Force  do  meet  the 
defined  requirement.  Some  cost  of  quality  must  exist.  The  nature 
and  size  of  that  cost  will  be  driven  by  a  variety  of  conditions. 

Program  phase 

Type  of  technology/product 
Governmental  contractual  requirements 
The  acquisition  strategy 
How  the  contractor  is  organized 
-  How  the  contractor  accounts 
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The  activities  that  are  underway  under  various  functional  areas  are 
shown,  as  an  example,  in  figure  ii-1  (note  that  not  all  functions  are 
shown) .  As  the  reader  moves  from  Chapters  one  through  three  and  the 
particular  functional  section  in  Chapter  four  in  which  he  or  she  is 
interested,  they  will  find  that  activities  highlighted,  and 
governmental  requirements  presented,  cover  the  various  phases  of  the 
acquisition  process  (see  Table  3-1) .  What  the  individual  evaluator 
must  recognize  is  that  a  degree  of  judgment  must  be  applied  when 
evaluating  cost  of  quality.  That  judgment  must  be  based  first  on  the 
functional  expertise  and  experience  of  the  evaluator  and,  second,  on 
a  thorough  review  of  the  nature  of  the  effort  being  evaluated  with 
regard  to  phase,  product,  and  the  above  listed  conditions. 

The  goal  is  not  to  reduce  cost  of  quality  per  se.  The  goal  is  to  use 
cost  of  quality  to  understand  where  the  costs  are,  by  function  and  by 
category,  and  to  understand  what  those  costs  reveal  about  both  the 
contractor's  approach  to  quality  and  the  effectiveness  of  that 
approach.  Proper  management  of  the  quality  effort  to  achieve  a 
"prevention"  posture  will  provide  the  best  return  to  the  government 
on  money  spent,  and  will  result  in  an  eventual  lowering  of  total  cost 
of  quality. 
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ACQUISITION  LIFE  CYCLE  TECHNICAL  ACTIVITIES 


Figure  ii-1 
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EXECUTIVE  SUMMARY 


The  Cost  of  Quality  Evaluation  Methodologies  Handbook  was  devel¬ 
oped  for  two  purposes.  First,  the  handbook  provides  a  detailed 
tutorial  on  the  meaning  and  value  of  the  cost  of  quality  concept. 
Second,  the  handbook  provides  specific  guidance,  by  functional 
area,  on  how  to  find  the  cost  of  quality,  how  to  judge  its  mean¬ 
ing,  and  how  to  use  it  in  combination  with  other  performance 
indicators  to  judge  the  effectiveness  and  efficiency  of  the  con¬ 
tractor's  quality  program. 

Traditionally,  quality  has  been  seen  as  the  responsibility  of  the 
Quality  and  Manufacturing  departments.  Quality  has  been  "inspec¬ 
ted  in".  Most  people  believed  that  it  costs  more  money  to  im¬ 
prove  quality.  Nonconformances  were  accepted  as  inevitable,  and 
were  handled  through  scrap,  rework,  repair,  or  use  as-is. 

The  traditional  view  has  been  wrong.  It  is  now  generally  recog¬ 
nized  in  the  quality  profession,  and  more  importantly,  well  be¬ 
yond,  that  quality  is  everyone  *  a  responsibility.  Every  function 
contributes  to  the  organization's  ability  to  create  quality  out¬ 
put.  For  example,  customer  requirements  must  be  accurately  cap¬ 
tured  and  communicated.  Engineering  drawings  must  be  correct. 
Purchase  orders  must  be  complete  and  accurate.  Work  instructions 
must  be  clear  and  performable.  Tests  must  be  set  up  properly  and 
the  right  data  collected  and  correctly  interpreted.  Inspections 
must  be  focused  on  the  important  characteristics  and  attributes. 
Shipping  and  handling  must  protect  the  product  and  get  it  to  the 
right  customer.  Failure  in  anv  one  or  more  of  these  functions 
will  adversely  affect  quality.  The  costs  associated  with  ensur¬ 
ing  the  quality  of  anv  functional  area  "output"  is  the  essence  of 
the  cost  of  quality  concept.  It  is  present  in  everybody's  func¬ 
tional  area. 

o  The  traditional  approach  to  cost  of  quality  has  focused 
on  scrap,  rework  and  repair,  which  represents  FAILURE. 
True  cost  of  quality  consists  of  four  cost  categories. 

Appraisal  costs  -  looking  for  nonconformances 

Failure  costs  -  disposing  of  nonconformances 

Internal  -  before  final  delivery 

External  -  after  final  delivery 

Prevention  -  avoiding  nonconformances 
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o  These  cost  categories  are  present  for  every  function  in 
a  company,  not  just  for  the  quality  and  manufacturing 
functions . 

The  cost  of  quality  is  not  an  end,  but  a  means  to  an  end.  It 
provides  visibility  for  management; 

o  into  the  total  cost  of  the  quality  effort. 

o  into  problems  reflected  by  the  relationships  between 

each  category,  relative  to  each  other,  and  to  the 
total . 

o  into  lower  organizational  level  contributions  to  the 

quality  effort. 

o  into  the  effectiveness  of  corrective  actions. 


The  relationship  between  each  cost  of  quality  category  is  impor¬ 
tant,  and  can  tell  a  great  deal  about  whether  a  given  quality 
program  is  "inspection  focused"  or  "prevention  focused".  Figure 
iii-1  illustrates  the  point. 

INSPECTION  FOCUSED  PREVENTION  FOCUSED 


Figure  iii-1 

Unless  management  analyzes  the  true  composition  of  the  cost  of 
quality  relative  to  what  is  being  contributed  to  each  category  by 
various  organizational  levels,  and  takes  action  to  eliminate 
problems  highlighted  by  cost  of  quality  figures,  having  the  data 
serves  no  worthwhile  purpose. 

The  authority  for  the  government  to  require  defense  contractors 
to  collect  and  use  cost  of  quality  data  stems  from;  the  direc¬ 
tion  and  instructions  contained  in  the  Federal  Acq^Jiisition  Regu¬ 
lation;  Department  of  Defense  Directives  and  Instruction;  various 
military  specifications  and  standards;  and  more  specifically  MIL- 
Q-9858A,  paragraph  3.6,  "Cost  of  Quality".  Contractors  are  spec- 


if Ically  required  to  collect  cost  on  "prevention  and  correction" . 
Correction  is  failure  cost,  as  it  deals  with  disposition;  and 
fits  the  failure  cost  definitions. 

Cost  of  Quality  data  will  normally  be  found  as  both  direct  and 
indirect  costs.  Direct  costs  can  usually  be  found  in  existing 
reports,  etc.  Indirect  costs  require  more  effort  to  develop  an 
accurate  estimate.  A  methodology  has  been  provided  in  the  hand¬ 
book  that  enables  an  analyst  to  determine  the  actual  work  content 
of  a  given  function.  Based  on  the  average  time  required  to  per¬ 
form  each  task,  and  the  frequency  of  the  task,  an  accurate  esti¬ 
mate  of  the  total  hours  can  be  made.  From  that  estimate,  those 
tasks  that  meet  the  cost  of  quality  category  definitions  can  be 
segregated,  and  cost  of  quality  estimated  for  that  function. 
Combining  the  functional  cost  of  quality  data  provides  a  total 
cost  of  quality  figure. 

Now  that  the  cost  of  quality  is  available,  by  functional  area  and 
as  a  total,  action  can  be  taken  to  use  the  data  as  a  management 
tool.  Areas  weak  on  prevention  can  be  addressed.  Improvement 
progress  can  be  tracked. 

People  in  every  functional  area  must  be  able  to  find  and  use  cost 
of  quality  information.  The  handbook  provides  guidance  in  this 
regard  for  each  of  the  following  functions: 

Program  Management 
Engineering 
Manufacturing 
Finance 

Quality  Assurance 
Sxibcontractor  Management 
Logistics 
Contracts 

Each  functional  section  provides  tests  of  typical  functional 
activities,  and  break  out  costs  of  quality  for  each  activity. 
Guidance  is  also  provided  on  which  category  of  cost  of  quality  is 
involved,  what  contractual  requirement  may  drive  that  cost,  and 
what  are  typical  measures  of  that  cost  in  terms  of  functional 
performance  (e.g.,  drawing  errors/1,000  drawings;  percentage  of 
purchase  orders  with  errors;  average  errors  per  work  instruction, 
etc. ) . 

Once  cost  of  quality  data  is  available,  its  meaning  can  be  judged 
in  combination  with  other  cost  performance  indicators.  For  exam¬ 
ple,  under  C/SCSC,  variance  from  budget  can  be  looked  at  for 
evidence  that  cost  of  quality  factors  are  contributing  to  the 
variance.  Likewise,  under  MIL-STD-1567A,  Work  Measurement,  vari¬ 
ance  analysis  can  now  include  judgments  about  what  role  cost  of 
quality  is  playing  in  labor  performance. 

Cost  of  quality  provides  a  valuable  tool  for  both  government  and 
industry.  Cost  of  quality,  when  properly  accounted  for  in  all 
functional  areas,  shows  what  it  really  costs  to  get  the  product 
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to  the  field.  If  ttat  product  is  not  performing  satisfactorily, 

be  made  about  the  effectiveness  and  efficiency 
of  those  resources  being  expended  in  the  quality  effort.  Action 
can  be  taken  and  results  tracked  to  correct  the  situation. 
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What  is  the  cost  of  quality?  The  traditional  approach  to  this 
question  has  seen  cost  of  quality  as  the  cost  of  failure,  or 
spoilage,  or  the  effort  required  to  bring  material  that  does  not 
conform  to  requirements  back  to  a  state  where  the  material  is  once 
again  acceptable  for  use.  The  focus  has  been  on  scrap,  rework,  and 
repair.  The  data  examined  has  encompassed  the  cost  of  the  material, 
and  the  man  hours  required  for  disposition  of  material  by 
manufacturing.  Often  the  data  is  expressed  as  a  percentage  of  direct 
labor,  or  in  the  case  of  the  material,  a  percentage  of  total  work 
center  output  value. 

The  approach  described  above  is  one  focused  purely  on  FAILURE.  Such 
an  approach  falls  short  of  identifying  the  true  cost  of  quality  for 
the  organization,  and  more  importantly,  fails  to  support  the  need  for 
multidisciplined  evaluation  of  problems  to  find  the  true  root  causes 
of  errors  and  to  eliminate  those  causes.  Failure  costs  are 
definitely  a  part  of  the  cost  of  quality,  but  only  one  part. 

The  cost  of  quality  is: 

"the  cost  of  all  efforts  expended  to 
find  nonconforming  output,  react  to 
actual  failures,  both  internally  and 
externally,  and  to  prevent  failures  from 
happening  in  the  first  place”. 

"costs  expended  in  the  effort  to  find 
non-conforming  output  are  called 
appraisal  costs" . 

"the  costs  of  actual  failures  themselves 
and  their  correction  are  called  internal 
failure  and  external  failures  costs" . 

"the  costs  of  efforts  designed  to  stop 
problems  or  failures  from  occurring  in 
the  first  place  are  called  prevention 
costs" . 

We  will  begin  by  looking  at  definitions  of  each  of  the  primary 
categories  of  cost  of  quality. 

Appraisal  Costs 

These  are  costs  that  anyone  expends  in  an  effort  to  judge  the 
acceptability  of  output  and  to  identify  any  instance  of 
non-conformance.  Key  terms  here  are  evaluation  activity, 
measure .  or  audit.  The  emphasis  is  on  compliance  with  quality 
standards  and/or  performance  requirements  for  any  "output" 
(purchase  order,  engineering  drawing,  circuit  card,  actuator, 
etc. ) . 
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Failure  Costs 

These  are  costs  that  are  associated  with  activity  required  to 
evaluate  and  either  correct  or  replace  output  that  fails  to  meet 
established  quality  standards  and/or  performance  requirements. 
The  emphasis  is  on  the  decision  regarding  what  to  do  and  then  the 
resultant  action.  Key  terms  are  determine .  disposition,  rework ^ 
scrap,  repair,  reaccompllsh.  or  correct. 

There  are  two  types  of  failure  costs: 

Internal  Failure 

These  are  incurred  prior  to  final  delivery  of  the  specific 
output  to  the  customer  (internal  or  external  customer) . 

External  Failure 

These  are  incurred  after  final  delivery  of  the  specific 
output  to  the  customer  (internal  or  external  customer) . 

Prevention  Costs 

These  are  costs  incurred  through  efforts  to  avoid  nonconforming 
output  from  occurring  in  the  first  place.  These  include  actions 
that  occur  prior  to  or  during  all  phases  of  business  activity. 
The  key  idea  here  is  that  these  actions  are  aimed  at  ensuring 
activities  will  be  do'ne  correctly  before  the  activities  actually 
take  place.  Thus,  errors  are  prevented  from  happening  in  the 
first  place. 

Understanding  the  general  concept  of  each  category  is  important. 
First,  knowing  what  costs  fall  under  each  category  requires  a  clear 
understanding  of  what  each  category  means.  Second,  the  level  of  cost 
in  each  category  can  tell  you  a  great  deal  about  what  kind  of 
approach  an  organization  has  towards  quality  in  general.  Third,  the 
relative  size  of  each  category,  when  compared  to  each  other  as  well 
as  to  the  total  cost  of  quality,  is  again  an  indicator  of  possible 
courses  of  action  needed  to  address  quality  issues  in  that 
organization. 

Table  1-1  provides  examples  of  the  types  of  activities  that  can  be 
found  under  each  of  the  four  main  categories.  Table  1-1  was  taken 
directly  from  the  American  Society  for  Quality  Control  publication, 
"Principles  of  Quality  Costs". 
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Table  1-1  provides  examples  of  the  types  of  activities  that  can 
be  found  under  each  of  the  four  main  categories.  Table  1-1  was 
taken  directly  from  the  American  Society  for  Quality  Control 
pxiblication,  "Principles  of  Quality  Costs”. 


Reprinted  by  permission,  American  Society  for  Quality  Control, 
"Principles  of  Quality  Costs",  1986 
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Appendix  A  contains  other  lists  taken  from  various  studies  and 
publications.  As  mentioned  earlier,  understanding  what  costs  fall 
under  each  category  requires  a  clear  understanding  of  what  each 
category  means.  Careful  study  of  the  definitions  given  above  and  the 
information  in  table  1-1  and  Appendix  A  should  give  the  reader  a  good 
grasp  of  the  basics.  Note  also  that  more  detail  is  provided  in  the 
individual  functional  sections  found  in  Chapter  four  of  the  handbook. 

One  word  of  caution:  It  is  easy  to  become  overly  concerned  about 
very  precise  placement  of  costs  in  the  appropriate  category.  While  a 
certain  degree  of  accuracy  is  certainly  important  to  avoiding  the 
erroneous  inflation  or  reduction  of  a  given  category,  experience  has 
shown  that  the  number  of  controversial  costs  is  usually  small  and 
that  the  danger  of  skewing  the  data  is  small.  The  best  rule  to 
follow  is  to  go  back  to  the  basic  definitions  of  the  categories. 

Let's  look  at  two  examples.  One  might  conclude  that  inspecting  a 
problem  area  with  the  purpose  of  preventing  defects  from  getting  out 
is  an  example  of  prevention  costs.  Go  back  to  the  definitions. 
Prevention  costs  are  incurred  through  efforts  to  avoid  non-conforming 
output  from  occurring  in  the  first  Place.  The  inspection  here  is 
clearly  finding  defects  after  they  have  occurred.  These  inspection 
costs  are  appraisal,  or  costs  incurred  in  an  effort  to  judge  the 
acceptability  of  output  and  to  identify  any  instance  of 
non-conformance.  Remember  the  key  terms:  evaluate,  measure,  or 
audit. 

Another  example  could  be  an  organization  which  has  found  that  a  group 
of  operators  has  been  turning  out  excessive  amounts  of  nonconforming 
output.  The  problem  turned  out  to  be  a  lack  of  clear  understanding 
of  requirements,  so  training  was  initiated.  Isn't  the  cost  of 
training  part  of  the  failure  costs,  since  the  training  is  the 
corrective  step  resulting  from  the  defects?  Again,  refer  back  to  the 
definitions.  Failure  costs  are  those  associated  with  activity 
required  to  evaluate  and  correct  or  replace  output  that  fails  to  meet 
established  quality  standards  and/or  performance  requirements. 
Remember  the  key  terms:  determine,  disposition .  rework,  scrap. 
repair,  reaccomplish,  or  correct.  Once  the  defective  output  has  been 
dispositioned,  attention  is  turned  to  determining  why  the  defects 
occurred  in  the  first  place  and  how  to  prevent  them  from  recurring. 
The  training  is  designed  to  do  that  and  therefore  it  is  a  prevention 
cost,  in  line  with  the  definition  for  the  prevention  category. 

BENEFITS  OF  COST  OF  QUALITY 

Now  that  the  cost  of  quality  categories  are  known  and  the  various 
costs  that  are  associated  with  each  category  are  recognized,  the 
value  of  having  these  costs  can  be  discussed.  A  very  important  point 

must  be  made.  Remember : _ the  cost  of  quality  is  not  an  end  in 

itself,  but  a  means  to  an  end.  Cost  of  quality  represents  one  of 
many  tools  available  for  use  in  improving  the  overall  quality  of  the 
products  that  the  Department  of  Defense  buys  for  use  by  defense 
personnel.  As  a  beneficial  tool,  cost  of  quality: 
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1. 


provides  visibility  into  the  total  cost  of  ensuring 
requirements  are  being  met. 


2.  points  to  problems  in  the  quality  program  that  are  reflected 
in  cost  of  quality  category  imbalances,  or  excessive  costs 
in  the  non-value  added  areas  of  quality  activity. 

3.  acts  as  a  diagnostic  tool  at  lower  organizational  levels  in 
Identifying  problem  areas. 

4.  allows  judgements  about  the  real  thrust  of  a  given  quality 
effort  from  the  perspective  of  "inspecting  quality  in" 
versus  "designing  and  building  quality  in". 

5.  allows  management  to  judge  the  effectiveness  of  corrective 
actions  taken  to  eliminate  root  causes  and  improve  quality. 

Once  cost  of  quality  has  provided  the  above  benefits,  other  quality 
management  tools  can  then  be  applied  to  work  problems  and  develop 
solutions.  A  contractor  cannot  be  expected  to  successfully  eliminate 
causes  for  defective  material  unless  he  has  good  visibility  into 
where  his  problems  are.  Assuming  he  is  doing  what  is  required  under 
other  contractural  requirements,  such  as  MIL-Q-9858A  and 
MIL-STD-1520,  his  overall  effort  will  now  be  significantly  enhanced 
due  to  the  benefits  of  having  cost  of  quality  data  available.  Let's 
examine  the  benefits  and  see  how  each  is  realized. 

Benefit  1;  Provides  visibility  into  the  total  cost  of  ensuring 
requirements  are  being  met.  Experts  in  the  field  of  quality  today 
agree  that  the  total  cost  of  quality,  expressed  as  a  percentage  of 
sales,  averages  between  15%  and  30%  for  American  Companies.  If  the 
reader  is  familiar  at  all  with  the  traditional  measures  of  scrap, 
rework,  and  repair,  these  numbers  totaled  as  a  percent  of  sales,  are 
typically  between  5  and  10%.  Why  the  difference?  Because  scrap, 
rework,  and  repair  only  represent  FAILURE  COSTS,  and  more 
specifically,  INTERNAL  FAILURE  COSTS.  Appraisal  and  prevention 
costs,  and  external  failure  costs  must  be  added  in  for  a  true  picture 
of  the  cost  of  quality.  Seeing  these  other  cost  categories  is  vital 
because: 

appraisal  costs  show  what  it  costs  to  find  the  items  that 
require  scrap,  rework,  repair,  or  use  as-is  actions. 

prevention  costs  show  what  level  of  effort  is  being  expended 
to  avoid  defective  output,  that  is  scrap,  rework,  or  repair 
actions  in  the  first  place. 

external  failure  costs  show  what  costs  are  incurred  after 
the  output  is  in  the  hands  of  the  customer  and  it  fails  to 
meet  customer  requirements. 

It  should  be  obvious  that  seeing  all  the  cost  categories,  in  all 
functional  areas .  is  the  only  way  to  know  the  true  total  cost  of  the 
quality  effort. 


in  the  non-value  added  areas  of  quality.  Now  that  the  total  cost  is 
visible,  and  particularly  in  view  of  why  each  category  is  important 
as  described  ahove,  attention  can  be  turned  to  the  relative 
importance  of  each  category,  both  to  the  total  and  to  each  other. 
Look  at  figure  1-1. 


figure  1-1 


Note  that  fully  half  the  cost  is  incurred  just  finding  defective 
output  (appraisal) .  Just  short  of  half  is  incurred  in  dispositioning 
the  defects  after  discovery  (failure).  Only  7%  is  incurred  in 
efforts  to  prevent  defects  from  occurring  in  the  first  place.  What 
does  all  this  mean? 

-  If  this  is  a  MIL-Q-9858A  contractor,  compliance  with 
paragraph  3.6,  which  calls  for  "prevention  and  correction  of 
defects"  is  clearly  heavy  on  the  correction  side. 

Failure  costs  are  high  as  a  percentage  of  the  total  because 
very  little  is  being  done  to  prevent  defects  from  occurring. 

If  this  is  a  MIL-STD-1520C  contractor,  multidiscipline 
action  to  determine  and  eliminate  root  causes  for  defects  is 
not  being  effectively  implemented. 

For  the  Air  Force  analyst,  a  logical  next  step  with  this  contractor 
would  be  to  look  at  data  on  repeat  nonconformances  and  overall  defect 
level  trends.  Chances  are  excellent  that  the  data  would  show: 

-  high  incidence  of  repeat  nonconformances. 

-  fairly  stable,  or  flat  trends,  showing  no  real  improvement 
over  time. 
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The  Importance  of  cost  of  quality  data  should  now  be  clearly 
apparent,  particularly  as  an  aid  to  point  one  toward  other 
indications  of  quality  activity  in  order  to  make  judgements  about 
whether  the  government  is  getting  what  is  is  paying  for  from  the 
contractor's  quality  system.  The  contractor  is  being  paid  to  find 
and  correct  defects  and  to  eliminate  the  causes,  so  as  to  prevent  the 
defects  from  recurring  in  the  future.  Further,  prevention  should  be 
active  up  front .  to  prevent  many  potential  defects  from  ever 
occurring  in  the  first  place.  A  contractor  operating  with  relative 
costs  of  quality  categories  as  shown  in  figure  1-1  will,  in  all 
likelihood,  have  a  total  cost  of  quality  in  the  15  to  35%  of  sales 
range. 

Now  look  at  Figure  1-2. 


Figure  1-2 


Note  that  almost  fully  half  of  the  total  cost  is  incurred  in 
preventing  defects  from  occurring  in  the  first  place  or  from 
reoccurring.  Also  note  that  as  a  percentage  of  the  total,  appraisal 
costs  is  40%,  not  far  from  the  percentage  in  figure  1-1.  Does  this 
mean  the  contractor  in  figure  1-2  is  still  inspecting  in  "quality"? 
The  answer  is  no,  for  the  following  reasons; 

with  the  heavy  emphasis  on  prevention  (assuming  it  is  an 
effective  effort)  defects  are  being  avoided  in  the  first 
place,  and  those  that  do  occur  are  not  repeating  in  the 
future . 


the  appraisal  effort  is  necessary  to  ensure  that  the 
prevention  effort  is  indeed  working  as  intended. 


-  the  low  failure  cost  percentages  would  tend  to  indicate  the 
prevention  program  is  effective. 

-  with  this  type  of  program,  looking  at  data  on  repeat  defects 
and  defect  trends  over  time  will  likely  show  very  low 
repeats  and  excellent  downward  trends. 

Although  appraisal  is  at  40%  of  the  total,  a  contractor  with  relative 
costs  of  quality  as  shown  in  figure  1-2  will  usually  have  a  total 
cost  of  quality  in  the  5  to  10%  of  sales  range.  In  this  case,  the 
actual  appraisal  effort,  and  its  associated  cost,  is  much  smaller 
compared  to  the  effort  in  figure  1-1, •  because  the  total  cost  of 
quality  is  lower. 

As  a  further  example  of  the  above  discussion  dealing  with  figures  1-1 
and  1-2,  real  data  from  The  Tennant  Company,  a  company  that  has 
successfully  implemented  a  quality  program  oriented  toward  preventing 
defects  in  the  first  place,  and  preventing  reoccurrence  of  defects 
that  do  occur,  is  presented  in  figure  1-3. 


COST  OF  QUALITY 


Reprinted  by  permission,  Tennant  Company,  "Quest  for  Quality",  1987 


Notice  that  as  effort  in  prevention  grew  as  a  percentage  of  the  total 
cost  of  quality,  the  total  cost  fell  dramatically.  Note  also  that 
appraisal  as  a  percentage  of  the  total  fell.  But  this  company 
expects  appraisal  to  stabilize  at  about  the  original  percentage  of 
the  total.  This  is  because  the  quality  organization  in  this  company 
is  now  performing  essentially  an  audit  function  to  ensure  everyone 
else's  quality  efforts  are  effective.  The  emphasis  on  everybody  is 
important,  and  ties  very  well  to  the  concepts  of  MIL-STD-1520C.  A 
multidisciplined  approach  to  analyzing  the  root  causes  of  quality 
problems  recognizes  that  many  functions  can  and  often  do  contribute 
to  generation  of  defective  output.  Unless  every  potential 
contributor  takes  an  objective  look  at  where  they  could  have  done 
something  to  cause  the  defect,  real  identification  and  elimination  of 
root  causes  cannot  take  place. 


1-8 


Why  does  the  emphasis  on  prevention  result  in  lower  overall  cost  of 
quality  and  better  quality  in  the  end  product? 

-  preventing  nonconformances  occurs  through  good  analysis  of 
all  "processes”  and  refinement  of  those  processes  so  they 
produce  little,  if  any,  defective  output. 

once  confidence  is  gained  in  "process"  capability,  less 


appraisal  effort  is 
integrity. 

needed 

to 

continue 

to 

verify  process 

- 

less  nonconforming 
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is 
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that  requires 
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As  an  Illustration  of  what  happens  look  at  figure  1-4. 


figure  1-4 
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Reprinted  by  permission,  American  Society  for  Quality  Control, 
"Quality  Costs:  Ideas  and  Applications",  1984 


Notice  that  the  100%  enforcement  point  reflects  high  appraisal  and 
failure  and  overall  total  cost  of  quality,  with  low  prevention.  The 
goal  is  to  optimize  total  cost  of  quality  through  that  increase  in 
prevention  needed  to  eliminate  defective  output,  such  that  failure 
and  appraisal  costs  are  minimized.  Notice  that  external  failure  is 
low  at  the  goal  point,  thus  providing  the  customer  the  best  output 
possible. 

Benefit  3 :  Acts  as  a  diagnostic  tool  at  lower  organizational  levels 
in  identifying  problems  areas.  Looking  back  at  table  1-1  we  are 
reminded  of  the  large  variety  of  individual  cost  elements  that  go  in 
to  each  of  the  cost  of  quality  categories.  For  example,  under 
prevention  costs  in  table  1-1  we  find: 
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Operations  Process  Validation 


-  Operation  Quality  Planning 

Design  and  Development  of  Quality  Measurement  and 
Control  Equipment 

Operation  Support  Quality  Planning 
Operator  Quality  Education 

-  Operator  SPC/Process  Control 

Consider  a  final  assembly  area  for  a  complex  mechanical  product,  such 
as  a  jet  engine.  The  cost  of  quality  for  the  area  is  again  made  up 
of  the  categories  of  prevention,  appraisal,  and  internal  and  external 
failure.  The  costs  at  this  level  contribute  to  the  overall  totals 
for  the  company.  Look  now  at  figure  1-5. 


COQ  -  TOTAL  COMPANY  COQ  -  FINAL  ASSEMBLY 


FAILURE  -  ax 


Figure  1-5 

It  is  entirely  possible  for  a  lower  level  unit  within  the  company  to 
have  cost  of  quality  relationships  that  are  significantly  different 
from  those  for  the  total  company,  as  shown  in  figure  1-5.  The  _ 
manager  in  final  assembly  should  be  concerned.  It  is  obvious  that  a 
hard  look  is  needed  at  what  is  being  done  in  the  area  of  prevention. 
Action  should  include  looking  at  the  cost  elements  listed  above  from 
table  1-1  for  Operations,  since  final  assembly  is  essentially  the 
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operation  of  putting  the  product  together.  The  types  of  failures 
being  found  by  the  appraisal  effort  should  also  be  examined  to 
determine  those  that  could  be  prevented  by  proper  emphasis  on  the 
individual  prevention  cost  elements,  and  more  specifically,  the 
prevention  activity  that  generates  those  cost  elements.  Valid 
questions  to  ask  are: 

-  What  are  the  failures  we  are  experiencing? 

Which  ones  are  contributing  most  to  failure  costs? 

Why  are  they  occurring? 

What  prevention  effort  is  underway  to  address  these  high 

contributors? 

Is  current  prevention  failing? 

-  What  are  all  the  possible  causes  for  these  high 

contributors? 

What  prevention  action  can  be  put  in  place  to  eliminate 

these  failures  now  and  in  the  future? 

Once  these  actions  are  taken  the  manager  can  then  move  to  benefit  jl5. 
having  visibility  into  cost  of  quality,  discussed  below. 

A  word  here  about  use  of  cost  of  quality  data  by  top  management  is 
appropriate.  Refer  again  to  figure  1-5.  If  top  management  looks 

only  at  the  total  cost  of  quality  and  the  relationship  between  the 
categories  they  are  not  going  far  enough.  In  the  above  example, 

looking  at  figure  1-5,  Cost  of  Quality  -  Total  Company,  at  the  make 

up  of  the  45%  prevention  relative  to  each  major  function's 

contribution  may  reveal  the  following  (figure  1-6). 


FUNCTIONAL  CONTRIBUTIONS  TO  PREYEWTION  COSTS 


ASSEMBLY 

rilURE  1-6 
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Al'-hough  prevention  is  45%  of  the  total  cost  of  quality,  final 
assembly  is  low  relative  to  the  percentage  of  contribution  of  the 
other  functions.  The  next  question  to  ask  is,  "What  are  the  relative 
contributions  to  failure  costs  (figure  1-7)?” 

FUNCTIONAL  CONTRIBUTIOW  TO  FAILURE  COSTS 


DESIGN  ENG.  PURCHASING  FINAL  MACHINING  PAINTING 


ASSEMBLY 


FIGURE  1-7 

It  is  obvious  that  30%  of  the  total  company  failure  costs  come  out  of 
final  assembly.  In  view  of  the  lower  effort  in  prevention  and  the 
high  level  of  failure  contribution,  top  level  management  should  be 
looking  to  final  assembly  management  to  analyze  the  situation,  take 
action,  and  report  back. 

There  are  a  variety  of  circumstances  that  can  and  do  dictate  the 
relative  relationships  among  functional  elements  and  their 
contributions  to  cost  of  quality.  The  example  is  intended  to  make 
the  point  that  management  at  all  levels  must  use  cost  of  quality  data 
as  a  tool  to  help  identify  and  solve  problems. 


iven  effort 


Benefit  4;  Allows  judgements  about  the  real  thrust  of  a  '  " 


rove  or  manage 


quality  in”  versus  "designing  and  building  quality  in”.  As  discussed 
under  benefit  1,  the  relative  size  of  prevention  and  failure  costs  to 
each  other  and  to  total  cost  of  quality  can  be  used  to  determine  the 
approach  to  quality  being  taken  by  a  given  company.  When  failure  is 
very  high  and  prevention  low,  then  appraisal  effort  is  mostly  to  find 
defective  output,  which  is  then  dispositioned.  On  the  other  hand, 
when  prevention  is  high  and  failure  is  low,  appraisal  is  mostly  to 
verify  that  prevention  is  indeed  working.  Appraisal  of  actual  output 
can  be  reduced  and  the  focus  changed  to  audit  of  processes  to  ensure 
process  integrity  is  maintained  so  that  nonconforming  output  does  not 
occur.  (^11  processes,  not  only  manufacturing  processes.) 
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Benefit  5 ;  Allows  aanaaeatent  to  judge  the  effectiveness _ of 

corrective  actions  taken  to  eliminate  root  causes  and  improve 
quality.  As  discussed  under  benefit  3 ,  once  a  manager  has  recognized 
that  a  problem  exists  by  evaluating  his  cost  of  quality  information, 
he  can  then  monitor  the  effectiveness  of  any  action  taken  to  correct 
the  situation  by  watching  how  his  cost  of  quality  reacts.  The  cost 
elements  that  go  into  his  cost  of  quality  should  also  be  checked  to 
be  sure  specific  actions  are  taken  (costs  here  increase)  and  that 
failures,  are  being  eliminated  as  a  result  of  these  specific  actions 
(costs  here  decrease) . 

BASES  USED  IN  COST  OF  QUALITY 

Another  important  area  to  consider  in  a  discussion  of  the  concept  of 
the  cost  of  quality  is  the  subject  of  the  bases  used  for  calculating 

cost  of  quality  and  for  making  judgements  about  what  the  costs  mean. 

Any  base  chosen  will  vary  in  absolute  terms  over  time  as  the  level  of 

business  activity  changes.  Experience  has  shown  that  no  matter  what 
the  base,  expressing  cost  of  quality  as  a  percentage  of  that  base  has 
proven  to  be  the  most  useful  approach.  Keep  in  mind  that  cost  of 
quality  is  measured  for  two  primary  reasons.  First,  cost  of  quality 
helps  to  identify  areas  which  need  attention  for  making 
improvements.  Second,  once  action  to  improve  is  underway,  cost  of 
quality  provides  a  means  of  measuring  the  actual  improvement 
achieved. 

In  deciding  the  bases  to  be  used,  a  close  working  relationship  is 
needed  between  the  accounting,  manufacturing,  and  quality 
departments.  An  easy  way  to  start  is  for  an  organization  to  look  at 
what  bases  are  currently  measured.  One  advantage  of  using  this 
approach  is  that  it  requires  no  changes  in  the  current  accounting 
system.  A  second  advantage  is  that  using  existing  bases  keeps  the 
information  on  a  footing  that  is  already  well  established  and 
understood  within  the  company.  Management  often  already  reacts  to 
these  bases,  so  expressing  cost  of  quality  in  these  terms  can  make  an 
impact  on  acceptance  of  the  cost  of  quality  numbers  and  the  use  of 
those  numbers  as  management  tool. 

Bases  that  are  frequently  used  include: 

total  production  costs 

net  sales 

total  purchased  material  costs 
total  work  center  output 
direct  labor  hours 
productive  direct  labor 
shop  -  cost  input 
-  contributed  value 
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equivalent  units  of  productive  output 


When  a  company  selects  the  bases  to  be  used,  several  important 
factors  must  be  considered: 

>  Are  the  bases  sensitive  to  increases  and  decreases  in 
production  schedules? 

-  If  methods  improvements  through  equipment  modernization  are 
achieved,  will  the  bases  be  affected  by  lower  direct  costs? 

Are  they  affected  by  normal  fluctuations  in  sales? 

Are  they  sensitive  to  fluctuations  in  the  price  of 
materials? 

The  matrix  provided  in  Table  1-2  shows  the  applicability  of  these 
factors  to  each  of  the  bases  previously  listed: 


BASE  FACTORS 


TABLE  1-2 


Sensitive 

to 

Prod.  Scix. 

Modemi- 
zatiaryicwer 
Direct  Labor 

Seasonal 

Fluctuation 

Materials 

Price 

Total  Production  Costs 

X 

Net  Sales 

X 

Tot2d  Purchased  Material 
Costs 

X 

Tot£d  Work  Center  Output 

X 

X 

X 

Direct  Labor  Hours 

X 

X 

Productive  Direct  labor 

X 

X 

Shop  Cost  Input 

X 

Contributed  Value 

X 

Equivalent  Units  of 
Productive  Output 

X 

X 
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Certain  bases  may  be  more  appropriate  for  use  in  one  area  than  in 
another.  It  is  perfectly  acceptable  to  use  a  different  base 
among  lower  level  cost  centers.  For  example,  production  would  be 
interested  in,  perhaps,  internal  failure  costs  as  a  percent  of 
total  production  costs.  Purchasing,  on  the  other  hand,  may  want 
to  look  at  appraisal  costs  as  a  percentage  of  total  purchased 
material  costs.  Engineering  may  want  to  consider  prevention 
costs  as  a  percent  of  design  engineering  labor  costs.  The  base 
selected  should  be  one  that  is  a  true  reflection  of  what  is  being 
expended  against  the  quality  effort  for  that  area. 

As  part  of  the  development  of  this  handbook,  interviews  were 
conducted  with  a  variety  of  companies  doing  business  with  the 
government.  Among  the  questions  asked  was  “How  are  you  express¬ 
ing  the  cost  of  quality?"  The  overall  results  of  these  inter¬ 
views  are  provided  in  Chapter  3,  and  Appendix  D,  but  in  terms  of 
bases  being  used  we  found  generally: 

-  cost  expressed  as  dollars 

-  cost  expressed  as  %  of  man  hours 

-  cost  expressed  as  %  defective 

-  cost  expressed  as  material  cost  in  dollars 

-  cost  expressed  as  a  %  of  sales 


JUDGING  THE  MEANING  OF  COST  OF  QUALITY  INFORMATION 

A  major  problem  for  a  government  analyst  in  looking  at  cost  of 
quality  numbers  is  how  to  judge  their  meaning  for  an  individual 
program.  For  example,  is  the  company  collecting  cost  of  quality 
by  department,  by  program,  and  by  business  unit,  or  only  as  a 
total?  As  shown  in  our  example  earlier,  dealing  with  the  total 
company  versus  the  cost  of  quality  for  final  assembly,  it  is  very 
important  for  management  to  understand  what  goes  into  a  company 
total,  and  for  lower  level  management  to  understand  what  their 
unit  contribution  represents.  The  breakdown  of  contributions  to 
the  total  cost  numbers  should  be  driven  by  a  logical  application 
of  the  structure  of  the  organization.  For  example,  see  Figure  1- 
8. 

EXAMPLE  COWPAWY  STRUCTURE 


TOTAL  COMPANY 


I  ABC  CORPOBATION 


BUSINESS  SECMANTS 
PRODUCT  LINES 


->■  (aerospace 


MARINE! 


COST  CONTROL 
CENTERS 


FIGURE  l-e 
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Understanding  the  contribution  of  each  of  the  levels  in  Figure  1- 
8  to  the  total  company  cost  of  quality  categories  is  important. 
Adverse  trends,  or  unusually  high  cost  at  a  lower  level,  may  be 
masked  when  combined  with  all  other  cost  center  input,  with  this 
in  mind,  looking  again  at  Fi^re  1-8,  one  could  consider  looking 
at,  for  example,  internal  failure  for  ''machining”  as  a  contribu¬ 
tor  to  ”Manufacturing''  as  a  contributor  to  "Fighter”,  as  a  con¬ 
tributor  to  "aerospace",  as  a  contributor  to  "total  company”  cost 
of  quality  (figure  1-9). 

PULLING  UP  COST  OF  OUAHTY  CONTRIBUTION  THROUOH  . 

THE  STRUCTURE  OF  THE  COMPANY 


FIGURE  1-9 


EVAIUATING  THE  COST  OF  QUALITY 


How  do  you  know  if  the  cost  of  quality  is  too  high  or  too  low,  or 
just  about  right?  Is  there  an  "acceptable  range”  for  cost  of 
quality?  Is  continual  improvement  the  real  goal? 

Recognize  that  at  the  producer  there  must  be  some  cost  of 
quality.  Otherwise  there  would  be  no  control  over  output  and  no 
measurement  of  whether  that  output  met  requirements.  It  would  be 
up  to  the  user  to  prove  the  item's  quality  through  actual  use. 
If  it  performed  as  required  and  met  all  requirements,  it  would 
be  judged  a  quality  product.  If  it  failed,  it  would  not  be 
judged  a  quality  product.  However,  allowing  for  the  user  to  find 
out  whether  the  product  is  usable  or  not  is  not  the  way  to 
determine  the  quality.  The  manufacturer  must  take  some  action  to 
determine  the  product's  acceptability  before  delivery.  (See 
Figure  1-10) . 
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It  is  obvious  that  if  the  manufacturer  is  going  to  expend  resources 
to  determine  product  quality  there  will  be  a  cost  associated  with 
those  resources.  If  the  quality  determination  effort  is  eliminating 
field  failures  (other  than  normal  wearout)  then  these  quality  efforts 
are  satisfactory  from  the  user's  viewpoint.  But  how  the  quality 
effort  is  applied  to  eliminate  field  failures  will  determine  to  a 
large  extent  how  much  it  costs.  If  the  user  is  paying  the  bills, 
then  the  cost  of  quality  is  a  factor  in  determining  the  end  item 
price. 

If  the  contractor  is  screening  all  products,  at  selected  intermediate 
stages,  as  well  as  just  before  final  delivery,  and  is  finding  and 
disposing  of  nonconforming  items,  then  the  production  process  is  very 
inefficient.  The  process  is  producing  defective  products.  If  the 
producer  knows  this  from  experience  gained  through  screening 
products,  then  allowances  will  be  built  in  (in  addition  to  the  cost 
of  actually  doing  the  screening  and  disposing  of  the  defects)  for 
extra  material,  extra  people,  etc.,  to  accommodate  the  scrap,  rework, 
and  repair  needed  to  correct/eliminate  the  defects.  All  this  extra 
allowance  adds  to  the  cost  of  the  final  product.  The  buyer  is  paying 
for  all  the  inefficiency  in  the  producer's  system.  The  producer  may 
have  an  effective  quality  program,  based  on  elimination  of  field 
failures,  but  not  an  efficient  quality  program  because  he  is  allowing 
inefficient  processes  to  generate  defects  and  is  passing  along  in  the 
cost  of  the  product  the  costs  of  finding  and  fixing  the  problems. 

(See  Figure  1-11) . 
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paying  for  inefficiency  in  producers  "processes” 

-  materials  allowance  for  scrap 

-  consumables  for  rework  and  repair 

-  extra  inspectors 

extra  inspection  equipment 

-  extra  production  people  for  rework 

extra  people  to  support  entire  MRB  program 

-  engineers 

-  quality  technicians 

-  clerks 


-  extra  time  to  redo  errors 

-  engineering  drawings 

-  purchase  orders 

-  bids/proposals 

"find  and  fix"  does  not  prevent  defects  from  reaching 
the  field.  Still  some  cost  of  external  failures.  High 
cost  of  internal  failure. 

Figure  l-li 
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What  is  described  above  only  addresses  the  readily  visible  costs 
associated  with  manufacturing.  What  about  costs  such  as: 


-  drawing  error  correction 

-  engineering  changes 

-  engineering  liaison  calls 

-  planning  revisions 
redone  purchase  orders 
incomplete  bid  packages 
re-inspection 

-  re-test 

pre-review  of  defective  material 

-  use  as-is 

All  these  are  examples  of  costs  associated  with  inefficient  processes 
that  are  generating  nonconforming  output  (engineering  drawing;  work 
instruction;  purchase  order)  and  require  extra  resources  to  correct 
or  dispose  of  the  nonconforming  material.  Once  more,  additional 
costs  are  generated  and  are  passed  on  to  the  customer. 

If  the  contractor  is  looking  for  nonconforming  output  and  is  taking 
steps  to  determine  the  real  cause  of  these  nonconformances,  and 
further,  is  putting  into  place  actions  that  not  only  eliminate  the 
nonconformances,  but  prevent  them  from  occurring,  then  he  is 
attacking  and  eliminating  the  inefficiencies  in  his  processes.  Costs 
previously  generated  to  accommodate  the  inefficiencies  are  greatly 
reduced  or  eliminated.  The  buyer  is  paying  for  a  program  that  will 
result  in  effective  and  efficient  production  and  on  schedule  delivery 
of  a  conforming  product,  and  should  not  be  paying  for  excess  costs 
needed  to  support  wasted  resources.  (See  Figure  1-12) . 
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The  optimum  situation. 

Defects  are  prevented  from  occurring. 

Defects  that  do  occur  are  found,  fixed,  and  prevented 
from  happening  again. 

Assuming  the  design  fulfills  all  user  requirements, 
reliability  and  maintainability  impact  of  defects 
getting  to  the  field  is  greatly  reduced. 

Cost  of  quality  is  low.  System  is  both  effective  and 
efficient. 


Figure  1-12 


This  all  bolls  down  to  answering  the  following  questions: 

-  Is  the  contractor's  product  failing  in  the  field  due  to 
nonconformances? 

-  Is  the  contractor  expending  most  of  his  quality  costs  in 
finding  and  fixing  nonconformances  before  they  reach  the 
field? 

Is  the  contractor  preventing  nonconformances  from  occurring 
in  the  first  place,  and  from  recurring  in  the  future? 


See  Table  1-3 . 
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Based  on  the  above,  what  do  we  currently  see  as  the  situation 
with  contractors  building  systems  for  the  Air  Force? 

The  Air  Force  recognizes  that  having  the  user  determine 
the  quality  is  not  a  viable  alternative.  Therefore,  we 
know  we  have  some  cost  of  quality. 

-  .  Generally  we  have  the  condition  of  "find  and  fix",  or 
100%  enforcement  of  specifications. 

A  small,  but  growing  number  of  aerospace  prime  and 
subcontractors  are  adopting  the  "prevention"  posture 
and  are  achieving  effective  and  efficient  quality  pro¬ 
grams  . 

A  large  share  of  the  costs  are  driven  by  the  specific 
requirements  the  Air  Force  places  on  contract.  (See 
Chapter  2,  Requirements) 


In  order  to  judge  whether  the  cost  of  cfuality  is  the  correct  cost 
for  a  contactor  or  for  a  particular  program,  apply  the  following 
approach : 


review  contractual  requirements  and  establish  a  clear  i 

understanding  of  what  is  required  and  what  role  each 
functional  area  plays. 

Determine,  based  on  functional  expert  analysis,  if  the 
effort  proposed  by  the  contractor  is  appropriate 
for  the  stated  requirement. 

Determine  the  cost  of  quality,  for  the  company,  as  well 
as  by  program  and  by  functional  area. 

Examine  the  contractor's  performance  for: 

nonconformance  trends 

repeat  nonconformance  occurrence 

supplier  rejects 

repeat  supplier  rejects 

field  failures 

repeat  field  failures 

test  results 
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-  relative  percentages  for -  prevention,  apprai¬ 
sal,  and  failure  costs 

-  waivers/deviations 

-  engineering  changes 

-  Trends  are  much  more  important  than  absolute  numbers 
for  performance  indicators.  (Note:  ensure  bases  being 
used  are  not  affecting  the  data.) 

The  meaning  of  the  trend  data,  relative  to  cost  of  quality,  must 
be  considered.  Note  that  high  levels  or  "up  trends"  correspond 
to  the  "Quality  unknown"  point  on  the  left  side  of  figure  1-13 . 
The  "steady  trend"  corresponds  (assviming  nonconformances  have 
fallen  and  are  now  stabilized)  to  the  "100%  enforcement"  point  in 
the  center  of  figure  1-13.  The  "down  trend"  indicates  movement 
along  the  x  axis  of  figure  1-13,  with  the  object  being  the 
achievement  of  the  "Goal"  point  on  the  right  side  of  figure  1-13. 
Also,  keep  in  mind  that  there  will  be  good  correlation  between 
indicators.  For  example,  nonconformance  trends  and  repeat  non¬ 
conformance  trends  will  generally  be  the  same,  although  some 
repeat  problems  can  exist  as  the  more  difficult  problems  are 
struggled  with.  The  same  holds  true  for  supplier  nonconformances 
and  repeat  rejects.  Field  failures  can  be  caused  by  bad  design 
as  well  as  failure  to  conform  to  the  design.  In  this  case,  de¬ 
fect  rates  can  be  low  and  declining,  but  field  failures  can  be 
going  up.  Failures  in  this  case  are  being  caused  by  a  design 
that  fails  to  meet  operating  requirements,  even  though  the  output 
is  made  to  specification.  Repeat  field  failures  are  an  indicator 
that  whatever  fixes,  i^  any,  are  being  incorporated  (assuming 
they  have  reached  the  field)  are  not  getting  at  the  root  cause. 
On  the  other  hand,  low  conformance  rates  and  high  field  failures 
can  indicate  that  the  quality  system  is  not  finding  noncon¬ 
formances  that  are  there,  and  the  nonconformances  show  up  only 
after  they  cause  a  field  failure. 


Figure  1-13 
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A  trend  for  a  particular  indicator  must  be  judged  from  a  short 
run  and  a  long  run  perspective.  If,  for  example,  a  contractor  is 
looking  at  data  monthly,  then  monthly  changes  must  be  judged 
individually  as  well  as  over  three,  six,  or  twelve  month  periods. 
Individual  changes  must  be  looked  at  in  context  to  the  overall 
trends.  Rate  of  change  is  also  important.  Overall  level  of  the 
data  is  also  important.  Let's  examine  each  of  these  situations. 

In  figure  1-14  we  see  monthly  changes  of  2%  in  each  month,  Janu¬ 
ary  through  June,  with  a  downward  trend.  Stability  set  in  at 
approximate  3-4%  for  July  through  September.  A  brief  upward  move 
occurred  in  June,  but  action  was  taken  and  the  trend  continued 
downward  in  July.  This  was  followed  by  a  significant  jump  in 
October  and  November,  not  only  in  absolute  numbers,  but  also  the 
rate  change.  The  causes  here  require  attention.  Despite  the 
sharp  drop  in  December,  it  is  too  early  to  judge  whether  the 
upward  trend  has  been  reversed.  (Notice  here  that  the  category 
could  just  have  easily  been  for  purchase  orders,  manufacturing 
planning,  retest,  or  bid  and  proposal  rework,  etc.  "Rework 
exists  throughout  the  organization.) 

BEWOBIC 
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S  OF 

DIRECT  LABOR 


FIGURE  1-14 

As  an  aid  to  looking  at  indicators,  their  trends,  and  their  rela¬ 
tionship  one  to  the  other,  table  1-4  is  provided.  To  use  it: 

-  Select  an  indicator  from  the  list  on  the  left  hand 
side,  running  top  to  bottom. 

-  Select  a  "trend  direction",  i.e.,  up,  stable,  or  down. 

Trace  across  left  to  right  and  see  what  the  other  indi¬ 
cators,  listed  across  the  top,  may  show  in  relation  to 
the  indicator  trend  selected. 
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Refer  to  footnotes  when  you  encounter  a  box  containing 
a  number.  The  number  corresponds  to  the  applicable 
footnotes . 


For  example,  if  you  select  “nonconforming,  trend  up",  reading 
across  you  find: 

-  repeat  nonconformances  usually  are  also  "up" 
test  failures  are  usually  “up" 
repeat  test  failures  are  usually  stable 
prevention  costs  in  cost  of  quality  will  be  low 
appraisal  costs  will  be  high 
internal  failure  costs  will  be  high 
external  costs  will  be  high 


Note  that  if  you  select  “Defects,  trend  down",  under  "test 
failures"  and  "external  failures”  you  have  footnotes  1,  2,  3,  and 
4  indicated. 

The  point  is  that  all  the  indicators  roust  be  looked  at,  both 
individually  and  in  relation  to  one  another,  to  make  sound 
judgments  as  to  their  meaning 
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LEGEND; 

U  -  TREND  IS  UP  OR  VALUE  IS  HIGH 
S  -  TREND  IS  STABLE  OR  VALUE  IS  MODERATE 
D  -  TREND  IS  DOVN  OR  VALUE  IS  LOV 


1.  Could  be  low  because  nonconformances  are  caught  before  items 
go  to  test. 

2.  Could  be  high  due  to  bad  design,  even  through  manufacturing 
nonconformances  are  caught  prior  to  test. 

3.  Could  be  low  because  nonconformances  are  not  occurring 
during  manufacturing  and  those  that  occur  are  found  and 
fixed  prior  to  shipment. 

4 .  Could  be  high  due  to  bad  design  even  through  manufacturing 
nonconformances  are  caught  prior  to  shipment. 

5.  Nonconformances  trend  may  be  stabilized,  but  ability  to 
lower  it  can  be  driven  by  repeat  nonconformances,  indicating 
lack  of  correction  of  root  cause. 

6.  Judged  only  against  repeat  nonconformances,  test  failures 
will  probably  be  down. 

7.  Testing  may  be  weeding  out  nonconformances,  but  more  likely 
quality  escapes  are  reaching  the  field. 

8.  Field  failures  can  be  controlled  to  a  degree  with  the  find 
and  fix  approach,  but  over  time  external  failure  will  be  at 
best  moderate. 

9.  If  appraisal  is  low  because  prevention  is  high  (and 
effective)  then  failure  may  be  driven  more  toward  low. 

10.  Could  be  high  if  low  internal  failure  means  system  is  not 
catching  nonconformances,  or  2  could  apply. 

11.  Numbers  3,  4,  7,  8,  and  9  may  apply. 


As  another  aid  to  understanding  the  relationships  between  the 
categories  of  cost  of  quality  and  the  various  indicators,  figure 
1-15  shows  three  situations.  As  you  move  from  the  top  to  the 
bottom,  the  cost  of  quality  category  relationships,  as  a 
percentage  of  total  cost  of  quality,  change.  Note  that  the  most 
likely  indicator  conditions  also  change.  Note  also  that  the  size 
of  the  total  cost  of  quality  gets  smaller  as  we  achieve  a 
prevention  focused  condition.  It  is  conceivable  that  the  total 
could  remain  fairly  constant.  Even  if  this  occurred,  the 
achievement  of  the  prevention  focused  condition  is  still 
providing  the  lowest  failure  rates  and  the  highest  customer 
satisfaction  in  the  field. 
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INTERNAL 

FAILURE 


APPRAISAL 


EXTERNAL 

VFAILURE 


NONCONrORMANCES  HIGH  OR  RISING. 

REPEAT  NONCONFORMANCES  HIGH  OR  RISING. 
SUPPLIER  REJECTS  HIGH  OR  RISING. 

REPEAT  SUPPLIER  REJECTS  HIGH  OR  RISING. 

TEST  FAILURES  HIGH  OR  RISING.  COULD  BE  STABLE 
OR  FALLING  IF  ‘FIND  AND  FIX*  IS  GETTING  DEFECTS 
PRIOR  TO  TEST. 

REPEAT  TEST  FAILURES  (SAME  AS  TEST  FAILURES). 
;  IS  A  -FIND  AHD  FIX*  SITUATION 


PREVENTION- 


NONCONFORMANCES  STABLE  OR  BEGINNING  TO  DECLINE. 
(ASSUMES  PREVENTION  EFFORT  IS  EFFECTIVE) 

REPEAT  NONCONFORMANCES  STABLE  OR  BEGINNING 
TO  DECLINE. 

SUPPLIER  REJECTS  STABLE  OR  BEGINNING  TO  DECLINE. 
POSSIBLE  THAT  ALTHOUGH  INTERNAL  QUALITV  IS 
STARTING  TO  IMPROVE,  EFFORTS  WITH  SUPPLIERS  ARE 
STILL  UCKING. 

REPEAT  SUPPLIER  REJECTS  (SAME  AS  SUPPLIER 
REJECTS). 

-  TEST  FAILURES  STABLE  OR  BEGINNING  TO  DECLINE. 


-  REPEAT  TEST  FAILURES  (SAME  AS  TEST  FAILURES). 


^INT. 

tXTAFAIL. 

JAILA 


APPRAISAL 


PREVENTION 


-  NONCONFORMANCES  ARE  LOW,  HAVE  BEEN  AND 
ARE  CONTINUING  TO  DECLINE. 

-  REPEAT  DEFECTS  NONCONFORMANCES  ARE  ALMOST 
NON-EXISTENT. 

-  SUPPLIER  REJECTS  ARE  LOW,  HAVE  BEEN  AND  ARE 
CONTINUING  TO  DECLINE.  IT  IS  POSSILBE.  BUT 
EXTREMELY  UNLIKELY,  THAT  SUPPLIER  REJECTS  ARC 
STILL  A  PROBLEM.  ONCE  THE  YALUE  OF  STRONG 
INTERNAL  PREVENTION  IS  RECOGNIZED,  IT  IS 
EMPHASIZED  WITH  SUPPLIERS. 

-  REPEAT  SUPPLIER  REJECTS  (SAME  AS  SUPPLIER 
REJECTS). 

-  TEST  FAILURES  ARE  VERY  LOW  AND  DECLINING. 

-  REPEAT  TEST  FAILURES  ARC  ALMOST  NON-EXISTENT. 
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THIS  IS  A  PREVENTION  FOCUSED  CONDITION 


COST  OF  QUALITY-REQUIREMENTS 


1.  A  question  often  exists  in  many  people's  minds  concerning 
just  what  legal  or  binding  requirement  exists  that  forms  the 
basis  for  cost  of  quality  collection  and  reporting.  VThile 
it  is  generally  recognized  that  MIL-Q-9858A  contains  a 
specific  reference  to  cost  of  quality,  there  are  many  other 
requirements,  based  in  regulation  and  law,  that  flow  from 
the  executive  and  legistlative  branches  down  to  the 
contractor.  What  follows  is  a  discussion  of  these  various 
requirements.  Tax-payers  •  demand  cost-effective  military 
systems  and  reliable  performance  throughout  the  acquired 
system's  life  cycle.  The  citizens  carry  their  views  to 
their  government  representatives  in  Congress  to  ensure 
defense  dollars  are  cost-effective.  The  Congress  of  the 
United  States  of  America  uses  its  legislative  powers  to  pass 
laws,  and  to  appropriate  monies  for  the  goods  and  services 
needed  to  operate  the  government.  The  Executive  branch  of 
government  is  responsible  for  implementation  of  the  laws  and 
expenditure  of  funds  as  authorized. 

2.  In  the  case  of  federally  acquired  goods  and  services  the 
Office  of  Management  and  Budget  (0MB)  through  its  Office  of 
Federal  Procurement  Policy  (OFPP)  issues  the  Federal 
Acquisition  Regulations  (FAR'S)  which  govern  the  acquisition 
of  all  federal  goods  and  services.  FAR  part  46  addresses 
Quality  Assurance  requirements.  (Figure  2-1) 

The  following  are  several  key  requirements  spelled  out  in  the  FAR 
part  46,  involving  Quality: 

"Agencies  shall  ensure  that  contracts  include  inspection  and 
other  quality  requirements  .  .  . 

that  are  determined  necessary  to  protect  the  government 
interest. " 

"The  contractor  is  responsible  for  carrying  out  its  obliga¬ 
tion  under  the  contract." 

"Agencies  shall  ensure  that  nonconforming  supplies  or 
services  are  rejected,  except  as  otherwise  provided  in 
46.407." 

Far  46.407  nonconforming  supplies  or  services  is  quoted  in  its 
entirety  for  emphasis  and  better  understanding.  Underlining  is 
for  emphasis! 
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FI  OWDOWN  OF  LEGAL  BASIS  FOR  COST  OF  QUALITV 


CONGRESS 


Figure  2-1 


(a)  Contracting  officers  should  reject  supplies  or  services 
not  conforming  in  all  respects  to  contract  regulrements 
fsee  46.102^ .  In  those  Instances  where  deviation  from 
this  policy  is  found  to  be  in  the  Government  *  s 
Interest,  such  supplies  or  ser’/ices  mav  be  accepted 
only  as  authorized  In  this  section. 

(b)  Contractors  ordinarily  shall  be  given  an  opportunity  to 
correct  or  replace  nonconforming  supplies  or  services 
when  this  can  be  accomplished  within  the  required 
delivery  schedule.  Unless  the  contract  specifies 
otherwise  (as  may  be  the  case  in  some  cost-reimburse¬ 
ment  contracts,  correction  or  replacement  shall  be 
without  additional  cost  to  the  Government . 
Subparagraph  (e)  (2)  of  the  clause  at  52  246-2 .  Inspec¬ 
tion  of  Supplies-Fixed-Price .  reserves  to  the  Govern¬ 
ment  reinspection  and  retests  because  of  prior  rejec¬ 
tion. 

(c)  (1)  In  situations  not  covered  by  (b)  above,  the  con¬ 

tracting  officer  shall  ordinarily  reject  supplies  or 
services  when  the  nonconformance  adversely  affects 
safety,  health,  reliability,  durability,  performance, 
interchangeability  of  parts  or  assemblies,  weight  or 
appearance  (where  a  consideration) .  or  any  other  basic 
ob j ective  the  specification.  However,  there  may  be 

circumstances  (e.g.,  reasons  of  economy  or  urgency) 
when  acceptance  of  such  supplies  or  services  is  deter¬ 
mined  by  the  contracting  officer  to  be  in  the  Govern¬ 
ment's  interest.  The  contracting  officer  shall  make 
this  determination,  based  upon- 

(i)  Advice  of  the  technical  activity  that  the 
material  is  safe  to  use,  and  will  perform  its 
intended  purpose; 

(ii)  Information  regarding  the  nature  and  extent 
of  the  nonconformance; 

(iii) A  request  from  the  contractor  for  acceptance 
of  the  supplies  or  services  (if  feasible) ; 

(iv)  A  recommendation  for  acceptance  or  rejection, 
with  supporting  rationale;  and 

(V)  The  contract  adjustment  considered  appropri¬ 
ate.  including  anv  adjustment  offered  bv  the 
contractor. 
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(2)  The  cognizant  contract  administration  office,  or 
the  Government  activity  directly  involved,  shall  furn¬ 
ish  this  data  to  the  contracting  officer  in  writing. 
Except  that  in  urgent  cases,  it  may  be  furnished  orally 
and  later  confirmed  in  writing.  Before  making  a  deci¬ 
sion  to  accept,  the  contracting  officer  shall  obtain 
the  concurrence  of  the  activity  responsible  for  the 
technical  requirements  of  the  contract,  and  where 
health  factors  are  Involved,  of  the  responsible  health 
official  of  the  agency  concerned. 

(d)  If  the  nonconformance  is  minor,  in  that  it  does  not 
affect  any  of  the  factors  referred  to  in  (c)  above,  the 
cognizant  contract  administration  office  may  make  the  deter¬ 
mination  to  accept  or  reject,  except  where  this  authority  is 
withheld  by  the  contracting  office  of  the  contracting  acti¬ 
vity.  To  assist  in  making  this  determination,  the  contract 
administration  office  may  establish  a  joint  contractor-con¬ 
tract  administrative  office  review  group.  Acceptance  of 
nonconforming  supplies  that  affect  any  of  the  factors 
referred  to  in  (c)  above  is  outside  the  scope  of  the  review 
group  and  must  be  handled  as  specified  there. 

(e)  Contracting  officers  shall  discourage  the  repeated  ten¬ 
der  fflC  nonconforming  supplies  or  services,  including  those 
with  only  minor  nonconformances .  by  appropriate  action,  such 
as  rejection  and  documenting  the  contractor  *  s  performance 
record. 

(f)  Each  contract  under  which  nonconforming  supplies  or 
services  are  accepted  as  authorized  in  fcl  above  shall  be 
modified  to  provide  for  an  eguitable  price  reduction  or 
other  consideration .  However,  when  supplies  or  services 
involving  minor  nonconformances  are  accepted,  the  contract 
shall  not  be  modified  unless  (1)  it  appears  that  the  savings 
to  the  contractor  in  fabricating  the  nonconforming  supplies 
or  performing  the  nonconforming  services  will  exceed  the 
cost  to  the  Government  of  processing  the  modification,  or 
(2)  the  Government's  interests  otherwise  require  a  contract 
modification. 

(g)  Notices  of  rejection  shall  include  the  reasons  for 
rejection  and  be  furnished  promptly  to  the  contractor. 
Promptness  in  giving  this  notice  is  essential  because,  if 
timely  nature  of  rejection  is  not  furnished,  acceptance  may 
in  certain  cases  be  implied  as  a  matter  of  law.  The  notice 
shall  be  in  writing  if- 

(1)  The  supplies  or  services  have  been  rejected  at  a 
place  other  than  the  contractor's  plant; 
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(2)  The  contractor  persists  in  offering  nonconforming 
supplies  or  services  for  acceptance;  or 

(3)  Delivery  or  performance  was  late  without  excusable 
cause . 

3.  The  Office  of  the  Secretary  of  Defense  (OSD)  is  responsible 
for  implementation  of  the  FAR'S  within  the  Office  of  the 
Secretary  of  Defense  (OSD)  and  its  Department  of  Defense 
(DOD)  components.  This  is  accomplished  through  policies 
contained  in  Department  of  Defense  Directives  (DODD's)  and 
Department  of  Defense  Instructions  (DODI's). 

Acquisition  actions  and  techniques  to  obtain  cost  effective  inte¬ 
gration  are  addressed  in  the  entire  series  of  DODD's  and  DODI's 
as  well  as  DOD  specifications,  standards,  regulations,  manuals 
and  pamphlets.  For  example;  DODD-5000.1  "Major  and  Non-Major 
Defense  acquisition  Programs,  September  1,  1987  and  DODI-5000.2 

"Defense  Acquisition  Program  Procedures,"  September  1,  1987  re¬ 

quire  cost  visibility  and  consideration  at  milestone/decision 
points  throughout  the  acquisition  process. 

The  DODD  4155.1,  "Quality  Program",  August  10,  1978,  establishes 
five  specific  objectives,  one  of  which  requires  assurance  that 
the  other  four  objectives  are  cost  effective.  The  DODD  4245.6 
"Defense  Production  Management",  January  19,  1984  states  it  is 
DOD  policy  to  plan  for  production  early  in  the  acquisition  pro¬ 
cess  and  to  integrate  acquisition  actions  to  ensure  an  orderly 
transition  from  development  to  cost-effective  rate  production. " 

Quality  history  which  includes  "quality  costs"  are  evaluated  as  a 
function  of  the  source  selection  process.  Recently,  some  solici¬ 
tation  packages  have  been  including  a  requirement  for  a  Quality 
Improvement  Plan  which  includes  anticipated  Cost  Of  Quality 
improvements . 

A  key  specification  is  MIL-Q-9858A  "Quality  Program".  Paragraph 
3.6  "Costs  Related  To  Quality",  is  quoted  here  in  its  entirety 
with  underlining  for  emphasis. 

"3.6  Costs  Related  to  Quality.  The  contractor  shall  main¬ 
tain  and  use  quality  cost  data  as  a  management  element  of 
the  quality  program.  These  data  shall  serve  the  purpose  of 
identifying  the  cost  of  both  the  prevention  and  correction 
of  nonconforming  supplies  (e.g.,  labor  and  material  involved 
in  material  spoilage  caused  by  defective  work,  correction  of 
defective  work  and  for  quality  control  exercised  by  the 
contractor  at  subcontractor ' s  or  vendor ' s  facilities) .  The 
specific  quality  cost  data  to  be  maintained  and  used  will  be 
determined  by  the  contractor.  These  data  shall,  on  request, 
be  identified  and  made  available  for  "on  site"  review  by  the 
Government  Representative."  (See  Amendment  Number  Two, 
dated  8  March  1985.) 
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CURRENT  GOVERNMENT  FOCUS 

Discussion  with  government  personnel  currently  involved  in  perform¬ 
ing  cost  of  quality  audits  revealed  that  the  concentration  has  been 
solely  on  the  FAILURE  cost  area.  The  explanation  given  is  that 
failure  cost  is  the  only  contractual  requirement  for  cost  of  qual¬ 
ity  that  currently  exists  in  MIL-Q-9858A,  paragraph  3.6  and  6.5, 
which  talk  to  ''cost  of  quality"  and  "...  correction  of 
failures."  It  is  the  opinion  of  the  authors  of  this  handbook  that 
this  interpretation  falls  short  of  what  is  required  of  contractors 
by  MIL-Q-9858A. 

Paragraph  3.6  specifically  states  PREVENTION  costs  are  required  to 
be  maintained.  Now  refer  to  paragraph  3.5  of  MIL-Q-9858A: 

"3.5  Corrective  Action.  The  quality  program  shall  detect 
promptly  and  correct  assignable  conditions  adverse  to  qual¬ 
ity.  Design,  purchasing,  manufacturing,  testj.nq  or  othe£ 
operations  which  could  result  in  SE  have  resulted  in  defec¬ 
tive  supplies,  services,  facilities,  technical  data, 
standards  or  other  elements  of  contract  performance  which 
could  create  excessive  losses  SE  costs  must  bg  identified 
and  changed  as  g  result  qf  thS.  quality  program.  Corrective 
action  will  extend  to  the  performance  qf  all  suppliers  and 
vendors  and  will  ^  responsive  fs  data  nnd  product  forwarded 
from  users.  Corrective  action  shall  include  as  a  minimxim; 

a.  Analysis  of  data  and  examination  of  product  scrapped 
or  reworked  to  determine  extent  and  causes; 

b.  Analysis  of  trends  in  processes  or  performance  of 
work  to  prevent  nonconforming  product;  and, 

c.  Introduction  of  reguired  improvements  and  correc¬ 
tions,  an  initial  review  of  the  adequacy  of  such 
measures  and  monitoring  of  the  effectiveness  of 
corrective  action  taken. 

Wording  under  3.5  (b)  is  specific  to  PREVENTION.  General  wording 
covers  APPRAISAL  and  FAILURE.  These  are  clear,  direct  requirements 
of  the  quality  program.  The  costs  associated  with  these  must  be 
captured.  Paragraph  3.6  calls  for  cost  of  prevention.  Corrective 
action  costs  are  part  of  failure. 

Now  look  at  paragraph  3.4: 

"3.4  Records.  The  contractor  shall  maintain  and  use  any 
records  or  data  essential  to  the  economical  and  effective 
operation  of  his  quality  program.  These  records  shall  be 
available  for  review  by  the  Government  Representative  and 
copies  of  individual  records  shall  be  furnished  him  upon 
request.  Records  are  considered  one  of  the  principal  forms 
of  objective  evidence  of  quality.  The  quality  program  shall 
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assure  that  records  are  complete  and  reliable.  Inspection 
and  testing  records  shall,  as  a  minimum,  indicate  the  nature 
of  the  observations  together  with  the  nximber  of  observations 
made  and  the  number  and  type  of  deficiencies  found.  Also, 
records  monitoring  work  performance  aM  £31.  inspection 
AQd  testing  shall  indicate  ths.  flggeptefeilitY  3£  wsck  3X. 
products  and  the  action  taken  in  connection  with 
deficiencies.  The  quality  program  shall  provide 
analysis  nnd  333.  o£  records  &s.  &  basjs,  fniL  management 
action. 

Here  again,  APPRAISAL  is  covered  by  the  requirement  to  maintain 
records  of  all  appraisal  activity.  FAILURE  is  covered  again  by 
reference  to  action  taken  in  connection  with  deficiencies  (failures 
and  their  disposition) .  Additional  wording  appears  under  paragraph' 
1.3,  Summary : 

"The  program  shall  facilitate  determinations  of  the  effects  of 
quality  deficiencies  and  quality  gastg  OH  price." 

"All  supplies  and  services  under  the  contract,  whether  manu¬ 
factured  or  performed  within  the  contractor's  plant  or  at  any 
other  source,  shall  be  controlled  at  all  points  necessary  to 
assure  conformance  to  contractual  requirements.  The  program 
shall  provide  isc  tilfi  prevention  find  ready  detection  o£  dis¬ 
crepancies  and  for  timely  and  positive  corrective  action.  The 
contractor  shall  make  objective  evidence  of  quality 
conformance  readily  available  to  the  Government  Representa¬ 
tive.  Instructions  and  records  for  quality  must  be 
controlled. 

Paragraph  6.5  is  specific  relative  to  costs: 

"The  contractor  shall  make  known  to  the  government  upon 
request  the  data  associated  with  the  costs  and  losses  in  con¬ 
nection  with  scrap  and  with  rework  necessary  to  reprocess 
nonconforming  material  to  make  it  conform  completely." 

Strict  interpretation  limits  the  basis  for  cost  of  quality  audit 
requirements  to  paragraph  3.6  (see  page  2-6)  under  failure  only, 
and  paragraph  6.5  misses  the  other  clear  requirements  in  MIL-Q  for 
capture  and  use  of  PREVENTION  and  APPRAISAL  costs,  as  well  as  all 
types  of  FAILURE,  not  only  scrap  and  rework  of  material.  The  sug¬ 
gested  contractual  clauses  contained  in  chapter  four  are  designed 
to  get  at  what  is  already  required.  Whether  these  or  similar  type 
clauses  are  adopted,  MIL-Q-9858A  clearly  covers  all  cost  of  quality 
in  its  present  form. 

OTHER  REQUIREMENTS 

Another  key  standard  involving  costs  of  quality  is  MIL-STD-1520C, 
"Corrective  Action  And  Disposition  System  For  Nonconforming 
Material,"  27  June,  1986.  The  primary  purposes  of  the  system  are 
to  identify  and  correct  causes  of  nonconformances,  prevent  recur¬ 
rence  of  wasteful  nonconforming  material,  reduce  the  cost  of  manu- 
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facturlng  inefficiency,  and  foster  quality  and  productivity 
inprovenent . " 


MIL-STD-1520C  Paragraph  5.7.4  Nonconformance  costs,  states  "The 
contractor  shall  determine  and  record  the  costs  associated  with 
nonconformances.  The  objective  of  generating  the  cost  data  is  to 
provide  current  and  trend  data  to  be  used  by  the  contractor  in 
determining  the  need  for  and  effectiveness  of  corrective  action. 
The  resultant  cost  data  shall  serve  as  a  basis  for  necessary  Cor¬ 
rective  Action  Board  (CAB)  and  Quality  Improvement  Project  (QIP) 
action  when  appropriate.  Nonconformance  cost  summaries  shall  con¬ 
sist  of  scrap,  rework,  repair,  use-as-is,  and  return  to  supplier 
costs.  Plus  other  costs  as  determined  appropriate  by  the 
contractor. ” 

Minimum  data  sximmarization  requirements  in  MIL-STD-1520C  paragraph 
5.8  include  all  costs  described  in  paragraph  5.7.4  of  MIL-STD- 
152 OC.  Preparation  of  the  required  data  shall  not  be  less  frequent 
than  quarterly.  The  contractor  shall  periodically  ensure,  both  in- 
house,  and  at  suppliers  where  appropriate,  that  audits  are  con¬ 
ducted  of  MIL-STD-1520C  requirements  to  verify  compliance  and  en¬ 
sure  effectiveness.  Nonconformance  costs  are  included  in  these 
audits . 

The  Defense  Logistics  Agency  (DLA) ,  who  administers  many  DoD  con¬ 
tracts,  issued  change  4  to  DLAM  8200.2.  This  change  was  "designed 
to  assure  uniformity  of  program  application  and  performance  of 
required  Defense  Contract  Administration  Services  (DCAS) ,  Quality 
Assurance  (QA)  functional  responsibilitie-?. "  This  change  also 
included  guidelines  which  helped  to  identify  the  types  of  costs 
generally  included  in  the  COQ  categories  of  Prevention,  Detection/ 
Assessment  and  Failures.  DLAR  8200.10  "Control  of  Nonconforming 
Material",  8  June  1987  reflects  an  increasing  effort  by  the  govern¬ 
ment  to  control  and  reduce  nonconformance  costs.  Under  the  author¬ 
ity  of  FAR  46-407  the  government  sent  a  signal  to  contractors  with 
DLAR  8200.10,  which  provides  a  means  to  transfer  nonconformance 
costs  back  to  the  contractor.  This  indicates  the  government 
intends  to  enforce  FAR  46.407  and  will  no  longer  accept  what  it 
considers  to  be  excessive  major  or  minor  nonconformance  of  product. 

The  aforementioned  requirements  can  be  affected  by  the  type  of 
contract  written,  priorities  within  the  contract,  and  flow-down  of 
requirements  to  suppliers. 

Other  contractual  requirements  and  standards  such  as  MIL-STD-1535A, 
MIL-STD-1528A,  and  MIL-STD-1567A  (especially  variance  analysis 
requirements)  involve  cost  of  quality  requirements  (details  pro¬ 
vided  under  functional  sections  4-5,  and  4-3) .  Additionally,  many 
other  requirements  exist  that  are  cost  effective  issues  involving 
quality:  design  to  cost,  life  cycle  cost,  logistics  support  anal¬ 
ysis,  reliability,  maintainability,  producibility,  value  engineer¬ 
ing,  pre-planned  product  improvements,  industrial  modernization 
improved .  methods  and  processes,  functional/physical  configuration 
audits,  production  readiness  reviews,  work  measurement, 
cost/schedule  reports,  cost  in  time  for  the  cognizant  CAO  to  direct 


ramedlal  corrective  actions,  process  requirements,  electronic 
stress  screening,  workmanship  practices,  training  -  testing  - 
Inspection,  purchase  orders,  failure  reporting  and  corrective 
action  system  (FRACAS),  equipment  -  facilities  -  resources, 
material,  procedures  -  Instructions,  shop  practices,  material 
shortage,  out  of  station  work,  schedule  not  realistic,  engineering 
drawings  (detail)  late/ changes,  lack  of  tooling,  planning/ changes 
not  well  coordinated,  qualification  of  suppliers,  bill  of  material 
shortfalls,  and  Inaccurate  records. 

Noncontractual  agreements  are  also  used  by  some  agencies  to 
establish  COQ  goals  and  commitments  when  contractual  requirements 
cannot  be  negotiated. 

There  are  a  wide  variety  of  professional  organizations  that 
establish  National  Consensus  Standards  or  Programs  which  are 
extremely  valuable  but  are  not  contractual  requirements.  For  exam¬ 
ple,  the  American  Society  of  Quality  Control  (ASQC)  has  published 
many  books  and  articles  that  define  quality  costs  and  explain  why 
quality  costs  are  Important  and  how  to  control  them.  Additionally, 
the  National  Association  of  Accountants  recently  published  a  book 
entitled  "Measuring,  Planning,  and  Controlling  Quality  Costs". 
Chapter  one.  Figure  1  and  Appendix  B  of  this  handbook  provide 
copies  of  the  cost  of  quality  items  these  professional 
organizations  have  Identified  as  applicable  and  useful  In  most 
cases. 

The  requirements  for  quality  cost  systems  have  existed  for  many 
years  as  a  means  of  highlighting  the  cost  of  poor  planning  and 
performance,  that  is,  the  cost  of  not  doing  things  right  the  first 
time.  However,  these  systems  have  not  been  well  understood  due  to 
problems  with  definition  and  application  to  specific  management 
tasks,  specific  job  tasks,  and  various  functional  areas  of  respon¬ 
sibility. 

An  adequate  definition  of  quality  cost  exists  today.  The  govern¬ 
ment  must  grasp  what  is  available,  adopt  a  standard  definition  of 
quality  cost  categories,  build  contract  requirements  that  are  flex¬ 
ible,  yet  adequately  integrate  all  cost-effective  efforts  including 
the  COQ  requirements,  and  develop  better  systems  for  documenting, 
measuring,  controlling,  and  reporting  costs  that  achieve  the 
desired  quality  in  on-schedule  delivery  of  goods  and  services. 

The  program  management  office  is  the  key  to  obtaining  the  integra¬ 
tion  of  all  factors  during  the  acquisition  process  and  to  ensure 
reasonable  and  cost  effective  COQ  requirements  exist  in  the  negoti¬ 
ated  contract.  The  contractor  must  comply  with  contractual 
requirements  by  planning  and  implementing  systems  that  control  cost 
of  quality.  The  suggested  cost  of  quality  contractual  clauses 
provided  in  Chapter  five  provide  ideas  on  ways  to  get  what  the 
government  wants . 
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3-1  METHODOLOGIES  -  GENERAL 


Cost  of  Quality  can  be  a  key  management  tool.  It  is  not  a 
solution  in  itself,  but  rather  a  major  tool  to  measure  pro¬ 
gress  or  lack  thereof  over  time.  But,  how  is  cost  of  qual¬ 
ity,  that  is,  the  cost  of  prevention,  appraisal,  and  of 
failure,  found? 

Just  as  quality  or  excellence  is  everyone's  responsibility, 
quality  costs  are  accrued  by  every  one.  Consequently,  they 
are  within  the  ability  of  everyone  to  identify  and  impact, 
to  a  greater  or  lesser  degree.  If  it  is  true  that  "what 
gets  measured,  gets  done",  a  measurement  of  cost  is  the 
first  step  toward  management  and  control  of  cost  of  quality, 
to  the  benefit  of  the  consumers,  producer,  and  suppliers. 

Earlier,  the  reader  was  introduced  to  cost  of  quality  defi¬ 
nitions  and  categorization  into  prevention,  appraisal,  and 
failure  costs.  These  same  categories  should  be  used  to 
quantify  costs. 

We  can  measure  cost  of  quality  in  many  ways,  depending  on 
the  category  being  considered.  For  example,  failure: 

Cost  of  nonconforming  units 

Mass  of  material  nonconforming 

Number  of  ECNs 

or.  Incorrectly  prepared  P.O.s 

But  only  by  costing  all  these  expenses  can  we  develop  a  true 
picture  of  the  impact  of  cost  of  quality  to  the  organiza¬ 
tion.  By  comparing  these  costs  to  other  performance  and 
financial  data,  opportunities  for  cost  reduction  and 
enhancement  of  material  quality  can  be  pinpointed.  Most 
importantly,  the  user  in  the  field  will  benefit  as  well  as 
the  producer.  Make  no  mistake,  there  is  no  trade  off  here. 
A  conforming,  quality  product  can  be  delivered  to  the  user 
and  the  producer  can  still  cut  his  cost  significantly. 
Recall  the  company  example  in  Chapter  one. 

As  an  enterprise  or  organization  develops  towards  excel¬ 
lence,  more  of  the  cost'  of  quality  -  shifts-  to'  prevention 
costs.  Such  an  organization  embraces  preventative  princi¬ 
ples,  and  high  c[uality  products  and  services  become  the 
result  of  thousands  of  mini-scale  efforts  and  decisions  over 
time.  Measuring  the  cost  of  quality  and  comparing  its 
development  over  time  allows  for  appraisal  of  the  many 
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efforts  and  decisions.  The  only  real  purpose  for  developing 
the  cost  of  quality  is  to  develop  a  keen  understanding  of 
where  process  and  product  improvement .  cost  reduction,  and 
quality  enhancement  can  be  achieved,  so  ^  ^  serve  the 
users  interest  equally  well  or  better  f Chapter  one.  Benefit 
#1  and  12Jl.  Developing  data  into  useful  information  and 
using  that  information  for  decision  making  is  the  goal. 
Information  is  power.  Sharing  the  cost  of  quality  informa¬ 
tion  allows  not  only  quality  assurance  professionals,  but 
managers  in  all  areas  to  study  processes  and  operations  and 
take  actions  designed  to  eliminate  waste  and  unnecessary 
effort,  and  promote  the  concept  of  "doing  it"  right  the 
first  time. 

But  where  do  we  find  costs  of  quality  and  types  of  activi-' 
ties  that  generate  these  costs?  Once  identified,  how  do  we 
express  the  costs  in  a  meaningful  manner  and  what  purpose 
will  this  data  serve? 

As  mentioned  earlier,  costs  of  quality  are  found  in  all 
areas  of  the  typical  organization: 

Finance  and  Accounting 

Human  Resources 

Materials  Management 

Manufacturing 

Engineering 

Distribution 

Marketing 

Customer  and  Field  Service 

As  explained  in  Chapter  one,  cost  of  quality  should  be  divi¬ 
ded  into  the  categories  of  Prevention,  Appraisal,  Internal 
Failure,  and  External  Failure.  The  listing  of  examples  in 
Table  1-1  is  taken  from  "Principals  of  Quality  Costs"  pub¬ 
lished  by  ASQC  (See  also.  Appendix  A)  .  Although  these 
represent  thorough  listings  of  cost  of  quality 
possibilities,  few  organizations  will  use  exactly  the  same 
categories.  Many  items  can  be  added  as  they  are  uniquely 
suited  to  a  particular  contractor  and  some  may  be  deleted  as 
inconsequential  or  not  necessary. 

Approaches  will  vary  from  contractor  to  contractor.  For 
example,  in  many  systems  capital  costs  will  not  be  measured. 
Capital  costs  would  include  such  items  as  floor  space  and 
capital  equipment,  as  well  as  the  associated  depreciation. 
Also,  indirect  costs  may  be  omitted.  Indirect  costs  may 
include  costs  such  as  customer  costs  associated  with 
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external  failure  which  are  not  reimbursed  by  the  contractor, 
interests  costs  (or  cost  of  money)  for  excess  inventories, 
vendor  quality  costs  affecting  the  contractor  (the  absence 
of  which  would  reduce  product  or  service  cost  to  the  con¬ 
tractor)  ,  overhead  costs  for  production  of  internal  fail¬ 
ures,  etc. 

Basic  Cost  of  Quality  Structure 

The  most  basic  of  quality  cost  systems  should  certainly 
include  the  following: 

-  Prevention 

a.  The  quality  organization  costs  except  for 
inspection,  testing,  and  failure  efforts. 

b.  New  product  testing  and  design  efforts. 

c.  Q  training 

d.  Supplier  reviews  and  audits 
Appraisal 

a.  All  inspection,  internal  and  external 

b.  Quality  data  and  information  development  and 
analysis 

c.  Outsourced  product  or  service  evaluation  and 
control  programs. 

d.  Product  reliability  testing 

e.  Inspection  and  test  equipment  and  supplies 

Internal  Failures 

a.  Scrap 

b.  Rework,  repair,  use  as-is 

c.  Failure  analysis 

d.  Engineering  changes 

e.  Purchase  order  changes 

f.  Design  re-evaluation 


External  Failures 

a.  Warranty  Costs 

b.  Returned  goods 

c.  Product  Liability  Insurance 


All  of  these  basic  costs  of  quality  should  be  available 
through  the  standard  accounting  system.  The  controller  or 
contractor  financial  contact  should  be  able  to  supply  these 
costs  in  a  relatively  accurate  fashion. 

Role  of  Controller  Function 

Proactive  participation  by  the  contractor's  accounting  or 
financial  representatives  will  benefit  in  achieving  the  most 
accurate  development  of  a  total  quality  cost.  It  must  be 
remembered  that  the  cost  of  quality  is  a  portion  of  the 
total  quality  program.  Cost  of  Quality  really  defines  the 
entire  quality  system,  in  terms  of  dollars.  The  cost  of 
quality  should  not  be  used  as  simply  a  cost  cutting  tool. 
Comparisons  to  previous  performance  over  time  is  the  primary 
purpose  for  the  cost  of  quality  (Chapter  1,  Benefit  #5). 
Comparison  to  other  firms  or  divisions  tends  to  be 
inaccurate  and  misleading  because  of  the  fact  that  account¬ 
ing  data  are  gathered  and  reported  differently  in  various 
organizations  and  enterprises,  product  lines  differ,  and 
management  approaches  vary  a  great  deal. 

The  quality  costs  are  to  be  found  in  many  areas.  It  is  at 
this  point  that  the  Quality  department  personnel  and 
accounting  personnel  must  interact.  The  quality  person  is 
primarily  responsible  for  the  accounting  of  nonconformances 
and  errors.  It  is  the  controller  and  accounting  personnel 
who  are  responsible  for  assigning  dollar  values  and  costs  to 
the  quality  effort.  Together,  they  must  bring  the  rest  of 
the  organization  under  the  total  cost  of  quality  umbrella. 

Incorporating  the  responsibility  for  cost  of  quality  with 
the  comptroller  allows  functions  across  all  departments  in 
the  company  to  participate.  In  addition,  the  costs  reported 
will  tend  to  have  more  credibility  because  they  come  from 
the  same  source  as  all  other  financial  data  for  the  company. 

Sources  for  Costs  of  Quality 

Most  of  the  cost  of-  quality  can  be  found  in  the  following 
sources: 
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In  the  event  that  government  contracts  for  goods 
or  services  are  involved,  certain  quality  require¬ 
ments  may  be  part  of  the  contract  purchase  agree¬ 
ment  (e.g.,  various  military  specifications,  MIL- 
Q-9858A,  MIL-STD-1520C,  MIL-STD-1535A,  MIL-STD- 
1567A,  Environmental  Test  Screening,  FRACAS,  etc.) 
Review  of  these  contractually  required  documents 
will  provide  a  basis  for  then  going  to  the  respon¬ 
sible  function  to  find  costs  associated  with  these 
quality  program  requirements. 


Chart  Qt  Accounts  General  Ledger 


In  the  chart  of  accounts  one  will  find  the  basic 
explanation  of  all  accounts,  systematically 
arranged,  applicable  to  a  specific  enterprise  or 
organization.  Figure  3-1  provides  an  example  of  a 
typical  chart  of  accounts.  The  example  is  not  all 
inclusive. 


The  general  ledger  will  list  all  detailed  or  svun- 
marlzed  transactions  for  the  business.  In  using 
this  source,  it  will  be  necessary  to  seek  guidance 
from  finance  or  pricing  personnel.  Many  costs  of 
quality  will  be  included  in  other  costs  posted  to 
the  general  ledger.  It  will  be  necessary  to  make 
estimates  or  complete  further  investigation  to 
establish  many  costs.  Keep  in  mind  that  estimates 
may  be  required,  and  it  is  far  better  to  use  esti¬ 
mates  which  are  made  on  an  informed  basis  than  to 
ignore  the  cost. 


Business  Plan  and  Budget 


This  document  will  provide  information  concerning 
indirect,  support  and  staff  efforts,  and  types  of 
costs  of  quality.  For  example,  all  costs  for 
returned  goods,  warranty,  and  field  service  should 
be  External  Failure  costs  and  recorded  on  the 
quality  cost  report  accordingly.  Training  costs 
should  be  appropriately  accounted  as  prevention 
costs.  In  some  cases  departmental  or  function 
operation  (i.e.,  engineering,  manufacturing)  bud¬ 
gets  will  contain  more  detail  than  the  corporate 
business  plan  and/or  budget.  Referring  to  these 
documents  is  a  logical  next  step. 


The  operating  budget  should  give  you  a  reasonably 
complete  listing  of  expense  by  account  and  cate¬ 
gory. 


3-5 


ABC  COMPANY 


CHART  OF  ACCOUNTS 
7-1-88 
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ACCOUNT  DFSCRTP'T'toN 
Salary 

Hourly  General 
General  Indirect 
Trucking 
Inspection 

Hourly  Maintenance 
Mech.  &  Ele.  Repair 
Die  &  Jig  Repair 
Janitorial 

Premium  Pay 

Hourly  Fringe  Benefits 
Vacation  &  Holidays 
FICA 
Welfare 

State  Employment  Ins. 
Fed.  Employment  Ins. 
Workmens  Compensation 

Salary  Fringe  Benefits 

Operating  Supplies 

Factory 

Janitorial 

Perishable  Tools 

Medical 

Medical 

Maintenance  Supplies 
Mech.  &  Elec.  Repair 
Die  Repair 
Building  Repair 

Utilities 
Gas  &  Oil 
Electric 
Telephone 

Nonconforming  Material 
Returned  Goods 
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Existing  C.O.Q,  Statement  o£  pepoyts 

Many  organizations  already  have  cost  of  quality 
programs  developed  to  some  level,  but  as  discussed 
in  Appendix  B  "Survey  Results",  most  concentrate 
on  failure  costs.  These  reports  can  add  valuable 
information  and  data.  A  clear  understanding  of 
the  data  should  be  obtained  so  that  costs  included 
in  this  data  are  not  duplicated  or  assumed  and  not 
stated  in  other  areas.  Nonconformance  data  will 
nearly  always  be  available  in  these  reports  and 
will  significantly  support  cost  of  quality  in  the 
manufacturing  area. 

LabQP  Reporting  Statements 

In  many  cases,  a  separation  of  appraisal  or 
inspection  time  versus  standard  operations  time 
will  be  provided.  In  many  others,  however,  it 
will  be  necessary  to  establish  estimates  for 
appraisal  cost  involved  in  direct  labor  efforts. 
(See  Analytical  Techniques  in  this  chapter.)  If 
the  contract  calls  for  MIL-STD-1567A,  Work 
Measurement,  then  data  should  be  available  (See 
also  Chapter  five,  page  2) . 

Capital  EguiPment  Listing  and  Calibration  Logs 

Appraisal  equipment  costs  and  user  groups  can  be 
identified  from  these  sources.  Calibration  logs 
and  reports  will  reside  with  the  Q.A.  personnel 
and  appraisal  inspection  Capital  Equipment  will  be 
located  with  O.H.  and/or  Finance. 

Customer  Service  -  Field  Service  Reports 

Returned  goods,  warranty  costs,  and  field  service 
costs  can  be  found  in  these  reports  which  will 
substantially  impact  the  External  Failure  Costs  of 
Quality. 

Interviews  and  Operation  Reviews 

In  many  cases,  without  benefits  of  hard  cost  data, 
it  will  be  necessary  to  estimate  certain  costs  of 
quality.  This  is  an  accepted  method  of  determin¬ 
ing  costs  of  quality  and  in  most  cases, 
supervisors  and  involved  engineering  personnel 
have  accurate  data  on  which  to  make  assumptions 
and  estimates.  In  other  circumstances  it  may  be 
advisable  to  review  the  process  concerned  and  to 


3-7 


develop  costs  based  on  the  effort  actually 
involved. 


The  technique  provided  later  in  this  chapter 
"represents  a  format  that  might  be  used  for  such  a 
-review  process. 

Summarizing  the  Cost  of  Quality 

When  the  data  has  been  obtained  or  developed  and 
each  cost  has  been  defined  as  a  prevention  cost, 
appraisal  cost,  internal  failure  cost  or  external 
failure  cost,  the  costs  should  be  summarized  and 
presented  as  a  Cost  of  Quality  Report.  Any  organ¬ 
ized  and  traceable  format  can  be  used,  such  as  the 
example  listed  in  Figure  3-4.  This  data  can  then 
be  used  to  develop  trend  analysis  to  measure  the 
improvement  of  product  service  quality  over  time. 
An  example  of  a  cost  of  quality  summary  report  is 
shown  in  Figure  3-4. 


DIRECT  COSTS 


COST  ACCOUNTING  APPROACHES 

In  terms  of  the  methodologies  used  by  the  contractor  to  account 
for  costs,  understanding  the  approach  used  will  enable  an  Air 
Force  evaluator  to  find  the  cost  of  quality  within  that  account¬ 
ing  technique.  Keep  in  mind  that  actual  visibility  of  or  access 
to  the  detailed  numbers  may  be  limited  by  type  of  contract  and 
what,  if  any,  cost  reporting  requirements  have  been  put  in  place. 

As  mentioned  in  Chapter  five  under  ”Verificartion' and  Audit”, 
contracts  with  formal  cost  and  schedule  reporting  provide 
accounting  basis  stemming  for  work  packages  and  planning 
packages,  as  well  as  cost  accounts.  Again,  recall  that  direct 
costs  are  covered  here,  but  not  indirect.  A  majority  of  the 
costs  associated  with  cost  of  quality  will  be  indirect  costs. 

Cost  Centers  -  usually  an  area  in  which  a  single,  distinguishable 
type  of  operation  or  function  is  performed.  Cost  centers  are 
typically  divided  further,  based  on  the  type  of  activity 
performed. 


-  Productive  Cost  Centers  -  specific  work  done,  directly 
traceable  to  the  product. 

Service  Cost  Centers  -  individual  activities  that  sup¬ 
port  productive  activities,  but  are  not  obviously 
traceable  to  a  specific  product.  These  are  normally 
classified  as  Indirect  costs. 

Cost  accounting  systems  are  usually  found  to  be  one  of  two  basic 
types.  There  are  the  Job  Order  and  Process  Cost  Systems.  Both 
can  be  either  a  historical  cost  system  or  a  predetermined  cost 
system.  Neither  approach  is  applied  in  its  "pure"  form,  but  more 
typically  is  modified  to  suit  the  particular  contractor's  method 
of  managing  his  business. 

Under  the  job  order  cost  approach,  costs  will  normally  be  accumu¬ 
lated  by  jobs,  lots,  or  orders.  Workers  will  identify  on  their 
time  cards  the  jobs  on  which  they  work,  and  a  calculated  overhead 
rate  is  then  applied.  Under  the  process  cost  approach,  costs 
will  normally  be  accumulated  by  units  of  product  within  each 
process  or  department.  Total  costs  for  producing  a  kind  of  unit 
and  the  number  of  that  kind  of  unit  produced  are  determined  for 
regular  accounting  periods.  Then  an  average  cost  for  the  period 
is  determined. 

The  vast  majority  of  Air  Force  programs  will  fall  in  the  job 
order  cost  area. 
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Another  approach  involves  the  use  of  a  Historical  Cost  System. 
The  job  order  cost  approach  can  also  be  called  a  historical  sys¬ 
tem  if  the  only  data  about  an  end  products'  production  are 
accumulated  after  the  end  product  is  produced.  Historical  data 
are  used  in  all  cost  accounting  systems,  at  least  as  a  basis  for 
comparing  actual  results  to  predicted  results.  The  reporting 
under  C/SCSC,  which  looks  at  budgeted  cost  of  work  performed 
versus  actual  cost  of  work  performed,  is  using  the  historical 
approach.  When  a  contractor  uses  historical  costs  as  a  basis  for 
projecting  what  the  future  costs  will  be,  it  is  important  to 
understand  that  many  cost  of  quality  elements,  and  their  associ¬ 
ated  costs,  are  driven  by  the  phase  of  the  program.  Table  3-1 
shows  a  breakout  by  major  functional  area  as  to  when  various 
actions  that  comprise  typical  cost  of  quality  items  occur  for 
each  phase  of  the  acquisition  process.  Note  that  the  detailed 
information  provided  in  each  functional  section  in  Chapter  four 
can  be  used  in  conjunction  with  Table  3-1  and,  when  combined  with 
judgement,  provide  a  good  basis  for  determining  exactly  when  (by 
phase)  a  particular  cost  of  quality  can  be  expected  to  occur. 

Closely  related  to  the  phase  of  the  program  is  the  recurring  and 
nonrecurring  aspect  of  many  costs.  Recurring  costs  are  those 
which  will  be  incurred  over  and  over  again  during  the  life  of  the 
program.  Examples  of  recurring  costs  are: 

production  material 

production  labor 

ST/STE  repair/maintenance 

-  expendable  tools  (drill  bits,  cutting/machine  tools, 
etc. ) 

Nonrecurring  costs  are  those  that  will  be  incurred  as  a  one  time 
effort,  and  are  expended,  will  not  be  repeated.  Examples  are: 

design  and  manufacture  of  special  tools/test  equipment 

plant  rearrangement 

tooling  (jigs;  fixtures) 

operating  instructions 

The  analyst  should  be  sure  to  consider  whether  a  proposed  cost  is 
recurring  or  nonrecurring,  and  whether  it  has  been  properly  pro¬ 
posed  and  would  be  expected  to  occur  in  the  phase  of  the  program 
being  considered. 

The  last  approach  that  bears  mentioning  is  the  Predetermined  Cost 
System  approach.  These  type  systems  accummulate  data  about  the 
production  of  an  end  product  before  the  end  product  is  produced. 
Cost  estimating  techniques  are  used  by  the  contractor  to  predict 
his  costs  for  doing  a  particular  job. 
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FlJNCriUN  i:i]N.  DEVEL  VALIDATION  FSD  PRODUCTION  DEPLUVriENI 


TESTABILITY - 1 - 

(NOTE:  ALL  THE  ABOVE 
FOR  HARDWARE  &  DESIGN 

COMPUTER  SOFTWARE)  REVIEWS  — 
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-PRR  - ' - > 

-WORK  MEASUREMENT 

-SUPPLIER  AUDIT - 

-OPERATOR IHSP  - 


FimcriON  CdN.  OEVEL.  VALIDATION  FSD  PRODUCTION  OEPLOVnENT 


ERRORS  - 

-FACILITY  DESIGN 
ERRORS  - 


COST  ESTIMATING 


There  will  be  occasions  when  it  is  necessary  for  the  Air  Force 
evaluator  to  develop  an  estimate  independently  from  the  contrac¬ 
tors  estimate  in  order  to  allow  for  judgement  about  the  validity 
of  the  contractor's  numbers.  There  are  a  variety  of  techniques 
used  in  developing  cost  estimates,  to  include  the  use  of: 

Estimating  relationships 

Special  Analogies 

Special  Estimates 

Rates,  factors,  and  catalog  prices 

Industrial  engineering  standards 

Cost  model  applications 

Trend  analysis 

Parametrics 

Bottoms  up 

-  Historical  costing 

It  is  not  the  function  or  intent  of  this  handbook  to  go  beyond 
providing  basic  tools  and  approaches  for  estimating  costs  of 
quality. 

The  starting  point  for  an  evaluator  must  be  a  thorough  under¬ 
standing  of  what  the  tools  are  that  are  required  by  the  contract. 

Once  the  the  tools  are  understood,  both  from  the  inherent  nature 
of  the  work  to  be  done,  as  well  as  from  the  specific  and  unique 
governmental  requirements,  the  analyst  can  use  the  information 
provided  in  Chapter  four  to  work  up  an  estimate  of  the  cost  of 
quality.  The  technique  outlined  under  "Analytical  Techniques" 
for  developing  an  empirical  estimate  is  based  on  a  detailed 
breakdown  of  the  actual  work  content.  Once  the  decision  has  been 
made  on  the  extent  to  which  the  analyst  must  do  independent  esti¬ 
mating,  the  sources  for  data  must  be  investigated.  The  following 
list  (Figure  3-2)  provides  some  typical  sources  of  data: 
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Figure  3-2 


Data  Description 

Engineering  drawings 

Product  specifications 

Written  description  of 
product 

Bills  of  material 

Organization  chart 
Ratios  of  labor,  support, 

Job  descriptions  and  skill- 
level  breakdown 

Collective  bargaining 
contract 

Definition  of  direct/ 
indirect  labor  categories 

Description  of  plant 
facilities 

Special  equipment  and 
processes 

Management  information 
system  and  ADP 
capability 

Manufacturing  capa¬ 
bility 

Process  sheets 

Make-or-buy  program 
Production  schedules 

Purchase  orders 


Data  Source 
Design  data  package 
Design  data  package 
Proposal 

Manufacturing  engineering, 
purchasing  department 

Personnel  department 

Personnel  department  and 
engineering  organization 

Wage  and  salary  administration 

Labor  relations  department 

DCAA  audit,  production 
management  wage  administration 
categories 

Proposal,  process  engineering 

ADP  management 

DCAS  capability  study,  prior 
contracts 

Industrial  and  manufacturing 
engineering  departments 

Proposal 

Solicitation,  proposal, 
production  scheduling 
department 

Purchasing  department 


Material  allowances 


Estimates 

Actual 


Prora tables 

Cost-Estimating  procedure 


Proposal,  bill  of  material 
Production  records  of 
start  quantity  less  shipped 
quantity 

Proposal  support  data 

Proposal,  cost  estimating 
department 


Production  output  records  Account,  production  control, 

management  information  system 


Rework  allowance 

Schedule  backlog 

Labor  efficiency  report 

Variance  from  standard 
performance 


Proposal  support  data, 
inspection  records,  quality 
control  department,  production 
management 

Production  scheduling 
department ,  management 
information  system 

Production  management, 
industrial  engineering 
department 

Cost  accounting  department, 
industrial  engineering 
department 


Breakdown  of  raw  material 
dispersals 

Estimated  spreadsheets 
Departmental  estimates 


Experience  curve 
derivations 


Cost  estimating 
worksheets 


Work  measurement 
standards 

Subcontractor 

quotes 

Historical  costs: 
Estimated  and 
actual  spreadsheets 


Inventory  control  department, 
material  stores 

Proposal  support  data 

Respective  department 
management 

Cost  estimating  department, 
industrial  engineering 
department 

Cost  estimating  department, 
industrial  engineering 
department 

Industrial  engineering 


Proposal,  make-or-buy  program, 
purchasing  department 


Contracting  officer,  direct 
cost  analysis  files 
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Direct  cost  factors 


Prior  contracts  in  contracting 
officer's  files,  contractor 
ADP  files 


Independent  audits 


DCAA,  private  consultants, 
NAVPRO,  APPRO,  DCAS 


Manufacturing 
engineering  files 


Process  sheets 
Manufacturing  process 
capabilities 
Engineering  drawings 
Bills  of  material 
Tooling  requirements 


Design  engineering  files 


Management  information 
systems 


Production  control 


Industrial  engineering 
files 


Product  specifications 
Reliability 
Quality 
Functionality 

Engineering  drawings 
Special  requirements 
Temperature 
Handling 

Summary  production  reports 
Inventory  Output 
Schedules 
Labor  efficiency 

Production  schedules 
Production  output  records 
Material  allowances  and 
accounting  procedures 
Bills  of  material  for  current 
jobs 

Material  storage  and  dispersal 
procedures 

Development  of  cost  estimating 
techniques 

Predetermined  time  values 
Standard  data 

Worksheets 

Work  sampling  studies 
Experience  curves 

Process  sheets 

Historical  labor  performance 
data 

Job  descriptions  and  skill 
breakdowns 

Description  of  plant 
facilities  and  capabilities 


Cost  estimating 
department 


Cost  estimating  and 
acciimmulating  procedure 
Departmental  manpower  requirements 
Product  material  estimates 
Experience  curve  applications 
Labor  performance  factors 

Quality  assurance  files  Inspection  plans  and 

procedures 

Rework  history 
Unusual  product 
specifications 

Purchasing  department  files  Current  purchasing  policy 

Purchase  orders 
List  of  vendors 
Quotes  from 
subcontractors 

Historical  purchasing  policy 
Make-or-buy  program 

Personnel  Department  Relative  labor  mix,  amount, 

and  quality 

Ratios  of  various  labor  groups 

Organization  characteristics 

Names  of  key  personnel  and 
contractor  organization 
terminology 

Production  management  Labor  performance  reports 

Files 

Definitions  of  labor 
categories 

Direct/ indirect 
Skilled/unskilled 

Top  Management  Explanation  of  questionable 

policies 

Authority  for  capital 
expenditures 

Knowledge  for  other  data 
sources 
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Accounting  department  Cost  breakdowns  of  labor 

files  category  versus  major  product 

assembly 

Differentiation  between  direct 
and  indirect  costs 

Breakdown  of  overhead  items 

Actual  cost  data  (historical) 


-Factors  that  must  be  considered  when  making  judgements  about  the 
nature  of  the  contractors  cost  estimates  must  include: 

Past  experience  with  similar/same  product 

Make/buy  situation 

State  of  contractors  manufacturing  capability  (modern, 
labor  intensive,  etc.) 

Quantity  to  be  produced 

-  Tolerance  requirements 

-  Amount  of  development  versus  standard 

-  Product  Complexity 

-  Contractors  readiness  (cold  or  warm  base) 

Manufacturing  technology  required 
Inspection/test  technology  required 


Always  keep  in  mind  the  phase  of  the  program,  and  recall  that  the 
level  of  effort  required,  and  the  nature  of  that  effort,  is 
directly  driven  by  the  phase  the  program  is  in,  or  will  be  in  at 
the  time  for  which  costs  are  being  estimated.  (Note  that  DoD 
4245. 7-M,  the  "Transition  Templates",  is  another  excellent  source 
of  cost  risk  areas,  broken  down  by  program  phase.)  With  all  this 
in  mind,  the  analyst  can  move  on  to  the  next  step. 
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INDIRECT  COSTS 


ANALYTICAL  TECRNIQUEg 

Where  the  data  needed  to  capture  cost  of  quality  is  not  readily 
available  through  the  sources  previously  described,  the  parti¬ 
cular  analyst  will  have  to  perform  some  analytical  action  to 
develop  an  estimate  of  the  cost.  This  is  usually  the  case  when 
dealing  with  indirect  costs.  This  analysis  can  be  done  for  a 
department,  a  section,  a  team,  or  for  an  individual.  The  tech¬ 
nique  differs  only- in  the  level  of  activity  being  reviewed,  which 
will  drive  the  values  foi.  the  individual  components  that  combine 
to  develop  the  estimate.  The  process  described  below  provides 
both  an  estimate  of  the  total  activity  as  well  as  an  estimate  of 
the  cost  of  quality  component  of  that  activity.  The  technique  is 
especially  useful  when  dealing  with  level  of  effort  kinds  of 
activity,  and  in  the  indirect  areas  where  the  costs  are  generally 
pooled. 

What  follows  is  an  instruction  sheet  that  outlines  the  step  by 
step  technique.  With  that  is  an  "Interview  -  Job  Breakdown  Work¬ 
sheet"  that  is  used  to  capture  the  data.  A  completed  example 
worksheet  is  also  provided  to  illustrate  the  actual  application 
of  the  technique.  Note  that  the  example  is  for  a  "non  tradition¬ 
al"  quality  measurement  area,  and  should  serve  to  reinforce  the 
point  that  cost  of  quality  is  found  in  all  functional  areas. 
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INTERVIEW  -  JOB  BREAKDOWN 


STEP  1 

STEP  2 

STEP  3 


STEP  4 

STEP  5 

STEP  6 

STEP  7 


Discuss  the  major  functional  responsibilities  of  the 
.job. 


List  the  major  activities  performed  under  each 
responsibility. 


Discuss  the  typical  occurrence  frequency  of  each  major 
activity,  usually  weekly  or  monthly .  quarterly,  etc. 

look  for  objective  evidence  of  that  frequency 

Ex.  number  of  drawings 

number  of  reports 
number  of  tests 
nvimber  of  items  produced 
number  of  failures 
number  of  purchase  orders 

Discuss  the  typical  time  required  to  perform  each  major 
activity.  Sources  for  these  times  may  be: 


established  standards 
individual  work  logs 

actual  observation,  or  a  "walk  through"  of 
the  activity  involved 


Determine  the  period  of  performance  for  the  proposed 
effort.  Usually  will  be  the  period  of  the  contract. 


Determine  if  the  activity  is  a  cost  of  quality.  If 
yes,  determine  which  category  it  represents. 


Calculate  the  hours  required: 


Frequency  x  Hours  x  Period  of  Performance  = 
hrs.  (for  each  major  activity) 

Add  up  all  the  individual  hours  to  arrive  at  a  subtotal 


Using  professional  judgment,  determine  factor  for  (if 
applicable) ; 


supervision  (%) 
miscellaneous  tasks  (%) 


Then  to  subtotal  Subtotal  Hrs 

add 

Supervision  factor  x  subtotal  Supervision  Hrs 

add 

Miscellaneous  task  factor  x  subtotal  Misc  Hrs 


Final  Estimate 


Hrs 
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INTERVIEW-JOB  BREAKDOWN 
WORKSHEET 


Functional  Area - 

Specific  Job  Title - 

Period  of  Performance  (weeks  or  months) 


PROPOSED  HOURS _ ANALYSIS  HOURS _ 


COST  OF  QUALITY:  PREVENTION.. 

INT.  FAILURE. 


.APRAISAL _ 

_EXT.  FAILURE. 


TOTAL  COST  OF  QUALITY  - 
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INTERVIEW-JOB  BREAKDOWN 
WORKSHEET 

Funclionol  ArBw  ^CJ4/i^/A/6- _ 

Specific  Job  Title _ B.  ^ _ _ 

Period  of  Performance  (weeks  or  monthgl  hioA/r//^ 


MAJOR  ACTIVITY 
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PREY  APP  INT  r  EXT  F 


SUB  TOTAL - 

SUPERVISION  FACT0R(_)  X  SUB  TOTAL  ~ 
MISC.  TASK  FACT0R(J£)  X  SUB  TOTAL - 


PROPOSED  hoursJJLJ^S—analysis  hours  774 

COST  OF  QUALITY;  PBFVFNTION  2-tf o  _  aPRAISAI 

INT.  FAIltlRF  ^  FXT  FAILURE— 


TOTAL  COST  OF  QUALITY  -  332 


METHODOLOGY 


Let ' s  review  Jsrief ly  what  has  been  presented  in  this  chapter  thus 
far: 

-  Sources  for  data  reflecting  cost  of  quality  have  been 
discussed. 

Various  approaches  to  cost  accounting  that  a  contractor 
may  use  have  been  described. 

Cost  estimating  techniques  for  use  by  the  Air  Force 
analysts  have  been  covered,  to  include  another  discus¬ 
sion  of  data  sources. 

An  analytical  technique  to  be  used  when  empirical  cost 
data,  of  the  detail  needed  by  the  analyst,  is  not 
available  has  been  provided. 

Discussions  and  a  checklist  for  use  when  making  judg¬ 
ments  about  either  proposed  costs,  or  the  analyst's  own 
estimate,  have  been  included. 

All  the  above  provide  the  tools  necessary  to  now  develop  the  cost 
of  quality  estimate  for  each  functional  area,  and  as  a  total  for 
the  contractor.  Using  the  tools  and  techniques  described,  the 
analyst  can  follow  the  flow  detailed  in  figure  3-3.  The  follow¬ 
ing  is  a  narrative  description  of  that  flow. 


Step  1.  Review  the  contract.  Ensure  complete  understanding  of 
exactly  what  is  required  of  the  contractor.  Special  emphasis 
should  be  placed  on  cost  of  quality  drivers.  Refer  to  the 
"drivers"  column  in  the  tables  provided  under  each  function  sec¬ 
tion  of  the  handbook  for  help. 

Step  2.  Review  the  cost  accounting  approach  used  by  the  contrac¬ 
tor.  Gain  an  understanding  of  exactly  how  the  contractor 
collects  costs. 

Step  3 .  Review  existing  data  sources.  Often  the  contractor  will 
have  a  variety  of  reports,  logs,  etc.,  that  can  provide  cost  of 
quality  figures.  These  figures  may  be  usable  numbers  in  their 
own  right,  or  may  provide  a  basis  for  making  an  estimate  of  some 
lower  level  figure. 

Step  4.  If  sources  do- not-  exist  such- that  the  analyst  can  read¬ 
ily  gain  visibility  into  cost  of  quality,  then  the  analytical 
technique  "Interview  -  Job  Breakdown"  should  be  used  to  develop 
an  estimate  of  the  work  content  associated  with  cost  of  quality. 

Note:  In  all  likelihood,  the  answer  to  the  question  "sources 
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exist?",  will  be  both  yes  and  no.  Sources  will  exist  for  some 
data,  and  not  for  others.  The  analyst  will  find  it  necessary  to 
go  down  both  branches,  i.e.,  ''yes"  to  "review  costs  proposed"  and 
"no"  to  "apply  analytical  technique".  Both  branches  lead  back  to 
step  5 . 

Step  5.  Apply  professional  judgment  to  the  costs/activities 
proposed.  Ask,  "Are  the  costs  for  the  right  effort?"  In  other 
words,  is  what  the  contractor  is  proposing  to  do  in  line  with 
what  he  is  required  to  do,  or  should  do,  as  a  normal  course  of 
action  in  that  particular  functional  discipline?  The  checklist 
in  appendix  C,  "Proposal  Review  Checklist",  will  be  useful  in 
accomplishing  this  step.  If  the  answer  is  "yes",  then  ask,  "Are 
costs  of  quality  evident?".  If  the  answer  to  either  of  these 
questions  is  "no",  then  go  to- step--6.  If  the  answers  to  both  is 
"yes",  go  to  step  8. 

Step  6.  Verify  contractual  requirement.  Be  sure  that  a  contrac¬ 
tual  basis  exists  for  a  given  effort.  Beyond  that,  good  commer¬ 
cial  practice,  or  accepted  functional  discipline  approach  can 
also  be  used  as  a  judgment  base  for  deciding  the  contractor  has 
not  proposed  the  correct  effort.  Once  a  requirement  for  the 
effort  is  established,  go  to  step  7. 

Step  7.  Submit  a  request  for  clarification  or  additional  infor¬ 
mation.  Either  the  contractor  neglected  to  include  information 
in  the  proposal  and  can  readily  provide  that  information  (in 
which  case,  go  to  step  8),  or  it  will  be  necessary  for  the  anal¬ 
yst  to  make  an  estimate  of  what  the  effort  should  be  using  the 
analytical  technique  under  step  4. 

Step  8.  Capture  cost  of  quality.  Now  judgments  can  be  made 
about  what  is  proposed,  or  has  been  estimated,  in  terms  of  what 
the  government  wants  to  achieve  by  having  cost  of  quality  data 
available  for  use  as  an  effective  management  tool. 
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STEP  5 


STEP 


-IS  COMTHACTOR  CAPTURING 
AND  USING  THE  DATA? 


FEED  COST  TO  TOTAL 
COST  OF  QUALITY 


TOTAL  COST  OF  QUALITY 


HOW  COST  OF  QUALITY  IS  SUMMARIZED 


BY  INDIVIDUAL  PROGRAM 

Basically,  once  the  techniques  described  here,  supported  by  the 
verification  and  audit  activities  outlined  in  Chapter  five  and 
the  functional  evaluations  in  Chapter  four,  have  been  completed, 
then  a  summary  of  cost  of  quality  for  a  particular  program  can  be 
put  together.  All  direct  costs  that  have  been  identified  can  be 
added  under  each -functional  area,  by  cost  of  quality  category. 
For  indirect  costs,  either  the  results  of  the  analyst's  estimate, 
or  the  contractor's  allocation  percentage  for  pooled  hours  can  be 
used  (if  more  than  one  program  is  supported  in  the  contractor 
plant) .  Again,  these  estimates  or  allocations  can  be  added  up 
under  each  functional  area,  by  cost  of  quality  category.  All 
these  costs  can  then  be  totaled  for  the  program,  as  shown  in 
figure  3-4.  Back  up  forms  detailing  each  function  may  also  be 
desired.  These  could  take  the  form  of  the  "Functional  Area  Work¬ 
sheets"  found  at  the  end  of  each  functional  section  in  Chapter 
five. 


FOR  THE  CONTRACTOR'S  TOTAL  COST  OF  QUALITY 


The  same  approach  as  described  above  for  a  specific  program  ap¬ 
plies  for  the  total  contractor  cost  of  quality.  In  this  case, 
all  direct  and  indirect  costs,  by  each  functional  area,  that  fall 
in  each  of  the  cost  of  quality  categories  is  added  up  under  each 
category  to  result  in  the  total  cost  of  quality  for  the  contrac¬ 
tor.  The  format  in  figure  3-4  applies  for  total  company  cost  of 
quality  also.  Again,  back  up  sheets  by  function  may  also  be 
desired. 
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TOTAL  COST  OF  QUALITY 


FOR 


FUNCTION 

CATEGORY 

PREYENTION 

APPRAISAL 

INT.  FAILURE 

EXT.  FAILURE 

TOTAL 

PROGRAM  MANAGEMENT 

ENGINEERING 

MANUFACTURING 

FINANCE 

QUALITY  ASSURANCE 

SUB  CONTRACT  MGMT 

CONTRACTS 

TOTALS 

%  _ %  _ %  _ % 


AS  OF  DATE _ 

DATE  OF  LAST  REPORT _ 

%  CHANGES  -  _  _  . 

Figure  3-4 
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Survey  Results 


As  part  of  the  work  done  to  develop  this  handbook,  a  telephone 
survey  (copy  in  Appendix  B)  was  conducted  with  63  contractors 
representing  the  entire  spectrum  of  products  procured  by  all  the 
buying  divisions  of  Air  Force  Systems  Command.  In  addition, 
visits  were  made  to  two  contractors  who  have  made  significant  use 
of  the  cost  of  quality  as  a  management  tool.  One  visit  was  made 
to  a  University  to  talk  with  a  recognized  expert  in  the  field. 

The  results  of  all  these  survey  activities  are  presented  in 
Appendix  B  to  give  the  handbook  user  some  insight  into  what  is 
the  current  thinking  on  cost  of  quality.  The  data  is  obviously 
only  a  sample  population.  As  time  toes  on,  the  environment  will 
change  and  most  likely  a  similar  survey  could  yield  different 
results.  The  data  is  presented  here  as  an  aid  in  thinking  about 
and  planning  for  dealings  with  industry  in  the  cost  of  quality 
area. 
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Functional  Sections  -  Introduction 


What  follows  are  the  detailed  functional  sections.  Each  is 
designed,  when  used  in  conjunction  with  the  rest  of  the  handbook, 
to  enable  the  particular  functional  specialist  to: 

identify  the  cost  of  quality  in  their  area 

understand  what  drives  the  cost  of  quality 

focus  on  typical  measures  of  the  cost  of  quality 

make  judgments  about  the  costs 

-  Are  the  costs  correct  (right  activities)? 

-  Are  the  costs  reasonable  (right  amount ; efficient) ? 

-  Is  there  evidence  that  the  costs  will  produce  the 
desired  results  (effective)? 

A  table  has  been  constructed  for  each  section  which  provides,  as 
applicable: 

a  list  of  major  functional  responsibilities 

-  a  list  of  specific  activities  for  each  major  respon¬ 
sibility 

-  a  list  of  cost  of  quality  efforts  for  each  activity 

a  list  of  conditions/requirements  that  tend  to  drive 
the  cost  of  quality  efforts 

typical  measures  of  cost  of  quality  effort 

The  purpose  of  the  table  is  to  enable  the  user  to  ask  the  right 
questions  when  evaluating  a  proposal  in  order  to  find  the  costs 
of  quality.  After  this  is  accomplished,  the  evaluator  can  then 
use  the  worksheet  provided  to: 

determine  those  costs  of  quality  that  apply 

document  the  costs  proposed  for  each  effort 

document  the  analyst's  allowed  costs 

indicate  the  basis  for  judgment 


use  of  these  aids,  and  the  evaluation  methodology  techniques 
described  in  Chapter  three .  applied  ^  ths.  specjgigg  in  each 
functional  area,  will  assist  the  evaluator  in  arriving  at  the 
desired  results-.  The  evaluator  should  rely  on  his  oe  her  experi¬ 
ence  and  judgment  when  using  these  aides.  They  are  not  meant  to 
provide  all  the  answers,  only  to  assist  in.  the  eyaluation 
process .  If  the  reader  has  not  done  a  thorough  job  of  studying 
the  earlier  sections  of  the  handbook .  or  some  time  has  past  since 
Initial  study .  a  review  is  strongly  recommended .  Key  areas  are 
the  definitions  of  the  primary  categories  of  appraisal,  internal 
and  external  failure,  and  prevention.  Proper  application  of  the 
definitions  given  in  Chapter  one  will  be  one  of  the  most  valuable 
steps  in  doing  a  cost  of  quality  evaluation.  The  concept  of  cost 
of  quality  being  present  in  all  functional  areas  is  also  vital  to 
proper  understanding  of  where  the  costs  can  be  found.  Typical 
costs  of  quality  that  apply  to  all,  or  most,  functional  areas 


are: 


training 

work  output  review 
testing 

error  accounting 

procedure  development/use/maintenance 
planning 


The  analyst  should  focus  attention  on  those  cost  of  quality  con¬ 
tributors  that  represent  major  costs.  It  is  not  possible,  in 
view  of  limited  government  personnel  resources  and  time  available 
to  analyze  the  given  situation,  to  expect  that  every  possible 
cost  contributor  can  be  found.  The  80/20  rule  -  or  the  view  that 
80%  of  the  cost  will  be  found  in  20%  of  the  activities  -  is  a 
good  rule  of  thumb  to  follow.  Again,  the  individual  functional 
analyst's  judgment  must  play  a  major  role. 
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PROGRAM  MANAGEMENT 


The  area  of  program  management  may  appear  on  the  surface  to  have 
little  to  contribute  to  the  cost  of  quality.  Remember,  however, 
the  term  "output"  used  in  Chapter  one.  Output  refers  to  any¬ 
thing  produced  by  any  function  in  the  organization,  not  only 
final  product  delivered  to  the  ultimate  customer.  Program  mana¬ 
gers  produce  a  vast  array  of  outputs.  Looking  at  the  typical 
functions  performed  by  program  management,  we  find: 

Organize 

Plan 

Build  Team 

Provide  Leadership 

Communicate 

Control 

React 

Handle  Customer  Relations 


In  performing  these  functions,  the  typical  program  manager  must 
be  concerned  with: 

Contract  Requirements 

Program  Plans 

Risk  Management 

Contract  Management 

Configuration  Management 

Functional  Management 

Subcontractor  Management 

Product  Performance 


Accomplishing  all  of  the  functions  outlined  above  allows  the 
program  manager  to  deal  with  the  list  of  items  he  must  be  con¬ 
cerned  with.  Action  to  build  the  correct  team,  made  up  of  the 


right  kinds  and  numbers  of  people,  will  ensure  that  the  various 
functional  activities  will  be  provided  for  and  accomplished.  To 
a  very  great  degree  the  upfront  work  done  by  the  program  manager 
to  build  the  right  team,  formulate  the  right  plan,  and  correctly 
implement  and  control  all  activity  under  that  plan  will  determine 
how  effective  the  organization  is  in  executing  the  program. 

Many  of  the  activities  performed  by  program  managers  are  part  of 
the  total  organization's  cost  of  quality.  Some  examples  are: 

Prevention 

-  Team  meetings  to  clearly  explain  contractual  require¬ 
ments 

-  Review  of  "lessons  learned"  from  past  programs 

Review  of  team  member  candidates  to  ensure  proper  qual¬ 
ifications  and  experience 

-  Training  (administrative  people;  program  management 
people) 

Appraisal 

Program  reviews 

-  Budget  reviews 

-  Functional  review  support 

-  Design  reviews 

-  Production  readiness  reviews 

-  Configuration  reviews 

Internal  Failure 

-  Typos/spelling,  etc.  during  plan  preparation 
Missed  meetings 

-  Missed  functional  coverage  in  plans 

-  Missed  coverage  of  contractual  requirement 

-  Internal  schedule  slippage 


Ext.ernal  Failure 

Incomplete/ inaccurate  bids  or  proposals 
-  Erroneous  program  status  reporting 
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Late  reports 

Missed  reports 

Program  schedule  slippage 


Program  plans  and  schedules  are  good  sources  for  identifying 
planned  program  and  functional  reviews.  Records  of  bid  and  pro¬ 
posal  activity  can  indicate  where  the  customer  received  inade¬ 
quate  or  erroneous  information  and  had  to  ask  for  resubmission  or 
clarification  (External  failure) .  Time  spent  by  program  manage¬ 
ment  people  preparing  for  and  participating  in  various  functional 
reviews  can  be  determined  from  interviews  and/or  meeting  minutes 
(Appraisal) .  Table  4-1-1  provides  the  breakout  of  responsibil¬ 
ities,  actions,  and  cost  of  quality  for  program  management.  The 
worksheets  which  follow  the  table  provide  a  method  for  the  ana¬ 
lyst  to  capture  the  cost  of  quality  for  a  specific  program. 
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COST  OF  QUALITY  FUNCTIONAL  AREA  WORKSHEET 


FUNCTIONAL -AREA  -  PROGRAM  MANAGEMENT 


ACTIVITY 

COVERED 

PROPOSED 

ALLOWED 

BASIS 

YES 

NO 

TRENDS 

ACTUALS 

JUDGE 

APPRAISAL 

PROGRAM  REVIEWS 

BUDGET  REVIEWS 

FUNCTION  REVIEW 
SUPPORT 

DESIGN  REVIEW 

PRODUCTION 

READINESS 

CONFIGURATION 

INTERNAL  FAILURE 

ERRORS  IN  PLAN 
PREPARATION 

MISSED  MEETINGS 

MISSED  FUNCTIONAL 
COVERAGE  IN  PLANS 

MISSED  COVERAGE  OF 

CONTRACTUAL 

REQUIREMENT 

INTERNAL  SCHEDULE 
SLIPPAGE 
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COST  OF  QUALITY  FUNCTIONAL  AREA  WORKSHEET 


FUNCTIONAL  AREA  -  PROGRAM  MANAGEMENT 


ACTIVITY 


EXTERNAL  FAILURE 


INCOMPLETE/ 

INACCURATE 

BID  OR  PROPOSAL 

ERRONEOUS  PROGRAM 
STATUS  REPORTING 

LATE  REPORTS 

MISSED  REPORTS 


PREVENTION 


TEAM  MEETING  TO 
CLARIFY/EXPLAIN 
PROGRAM  REQUIRE¬ 
MENTS 

REVIEW  OF  "LESSONS 
LEARNED" 

TRAINING 

SCREENING  OF 
PROGRAM  TEAM 
CANDIDATES 


TOTALS 


ENGINEERING 


Engineering  specialties  are  those  disciplines  which  support  the 
design  process  by  applying  knowledge  from  a  specific  area  to 
ensure  system  operability  in  its  intended  environment.  These 
disciplines  include,  for  example: 

reliability 

producibility 

maintainability 

human  engineering 

transportability 

safety 

electromagnetic  compatibility 
parts/materials/processes 

All  these  specialists  are  integrated  into  the  Systems  Engineering 
process.  Once  the  customer's  requirements  have  been  clearly 
established,  it  is  the  engineering  function's  job  to  convert 
these  requirements  into  a  solution  that  meets  those  requirements. 

Many  of  the  specialist  functions  performed  by  engineering  are  in 
and  of  themselves  directly  related  to  the  quality  of  the  final 
product,  under  reliability  engineering,  test  engineering,  and 
liaison  engineering. 

Judgments  about  the  acceptability  and  appropriateness  of  all 
planned  engineering  tasks  and  the  man-hours  proposed  to  perform 
those  tasks  will  be  made  by  the  government  evaluator (s)  in  the 
engineering  function.  As  part  of  the  evaluation  of  planned 
tasks,  the  evaluator (s)  should  look  for  the  presence  and  absence 
of  tasks  normally  associated  with  the  cost  of  quality.  Refer  to 
the  second  and  third  columns  of  table  4-2-1  as  a  guide  to  iden¬ 
tifying  these  tasks.  Beyond  the  identification  of  the  tasks, 
professional  judgment  concerning  the  resources  (time,  manpower, 
and  equipment)  proposed  against  each  task  is  then  applied.  It  is 
possible  the  evaluation  will  result  in  both  increases  as  well  as 
decreases  being  judged  appropriate. 

Table  4-2-1  provides  a  breakdown  of  the  typical  Systems  Engineer¬ 
ing  functions  and  tasks  one  can  expect  a  contractor  to  be  per¬ 
forming.  The  applicability  of  some  tasks  may  be  dictated  by  the 
program  phase.  Others  may  be  driven  by  contractual  requirements 
imposed  by  the  government,  as  shown  in  the  fourth  column.  Typi¬ 
cal  measures  of  these  costs  of  quality  are  provided  in  column 
five. 
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Examples  of  Cost  of  Quality  in  engineering 
Appraisal  (evaluate,  measure,  or  audit  output) 

-  Design  reviews 

-  Drawing  review 

-  Test  audit 

-  Evaluate  design  for  R  M  and  Producibility 
Checking  CAD,  CAE,  Drafting 

Vendor  quality  tracking 

Failure  (determine,  disposition,  rework,  repair,  scrap,  correct 
defective  output) 

internal  (before  delivery) 

-  Drawing  errors  prior  to  release 

-  Design  errors  prior  to  release 

-  Redesign  problem  solving  prior  to  release 
Debug  CAD,  CAE,  Drafting  programs 

-  Test  equipment  failure 
MRB  support 

external  (after  delivery) 

-  Drawing  errors  after  release 
Design  errors  after  release 

Redesign  problems  solving  after  release 
Liaison  calls 


Customer  acceptance  test 

Field  return,  evaluation/disposition 

Field  service 


prevention  (avoid) 

Develop  naintain/use  of  design  handbooks 

-  Training 

Test  planning  and  design 

Establish  Quality  Assurance  Requirements 

-  Vendor  qualification  requirements 

Document/ validate  CAD,  CAE,  Drafting 

-  Test  audit/set  up 

-  Vendor  surveys 


Now  look  at  table  4-2-1  for  detailed  breakout  of  major  engineer 
ing  responsibilities,  specific  actions,  associated  cost  of  qual 
ity,  and  method  for  capturing  those  costs. 


Table  4-2-1 
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RELIABILITY  MMLYSIS  PREVBirmN  -  K1L-S-7858B 


Table  4-2-1 
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Table  4-2-1 
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IMJCR  RESFONSIBHITY 


Table  4-2-1 
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FIRST  PIECE  APPROVALS  APPRAISAL  -  im-S-2168 
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COST  OF  QUALITY  FUNCTIONAL  AREA  WORKSHEET 


FUNCTIONAL  AREA  *  ENGINEERING 


ACTIVITY 


APPRAISAL 


DESIGN  REVIEWS 

DRAWING  REVIEWS 

TEST  SET  UP  REVIEW 

TEST  AUDIT 

DESIGN  EVALUATION 
FOR  R  &  M 

VENDOR  QUALITY 
TRACKING 

CHECKING  CAOD,  CAE, 
AND  DRAFTING 

PROCESS  REVIEWS 


INTERNAL  FAILURE 

DRAWING  ERRORS 
BEFORE  RELEASE 

DESIGN  ERRORS 
BEFORE  RELEASE 

REDESIGN  PROBLEM 
SOLVING  BEFORE 
RELEASE 

DEBUG  CADD,  CAE, 
DRAFTING  PROGRAMS 

TEST  EQUIPMENT 
FAILURE 

MRB  SUPPORT 


COST  OF  QUALITY  FUNCTIONAL  AREA  WORKSHEET 


FUNCTIONAL  AREA  -  ENGINEERING 


ACTIVITY 


EXTERNAL  FAILURE 

DRAWING  ERRORS 
AFTER  RELEASE 

DESIGN  ERRORS 
AFTER  RELEASE 

REDESIGN  PROBLEM 
SOLVING  AFTER 
RELEASE 

LIAISON  CALLS 

FIELD  SERVICE 

WARRANTY  RETURN 
EVALUATION/DISPOS. 


PREVENTION 

DEVELOP/USE 
MAINTAIN  HANDBOOKS 

TRAINING 

TEST  PLANNING  AND 
DESIGN 

ESTABLISH  QA 
REQUIREMENTS 

DOCUMENT/VALIDATE 
CADD,  CAE 

TEST  SET  UP/AUDIT 

VENDOR  SURVEYS 


\mm>i 


YES  NO  proposed  ALLOWED  jRENDS  ACTUALS  JUDGE 


TOTALS 


MANUFACTURING 


The  manufacturing  function  consists  of  people  with  a  diverse 
number  of  disciplines  and  skills,  who  collectively  utilize  infor¬ 
mation  and  allocated  resources  to  produce  a  product. 

For  example,  the  manufacturing  function  includes  some  of  the 
following  skills  and  disciplines: 

Industrial  Engineering 

Facilities  Engineering 

Manufacturing  Engineering 

Manufacturing  Planning 

Tooling  Engineering 

Production/Configuration  Control 

Software  Programmers  -  Automated  Systems/Eguipment 

Material  Management 

Computer  Aided  Manufacturing 

Plant/Equipment/Tooling  -  Maintenance 

Standards/ Documentation  Records  Management 

Shop  Management 

Crib  Management 

Fabrication 

Process  Management 

Assembly 

Management  Information  Systems  Management 

Manufacturing  Inspection/Test 

Training 

Producibility 

Internal  Audit  Management 

Safety 
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Each  of  these  activities  is  integrated  into  the  overall  manufac¬ 
turing  process.'  All  manufacturing  activities  must  be  considered 
for  cost  of  quality  when  a  company  enters  competition  for  a  gov¬ 
ernment  contract. 

When  a  company  is  awarded  a  contract,  it  is  imperative  that  ini¬ 
tial  quality  planning  for  the  manufacturing  requirements  be  con¬ 
ducted  at  the  earliest  practical  time.  Quality  costs  for  manu¬ 
facturing  must  be  identified  for  each  contractual  phase  (i.e., 
development,  full  scale  development,  low  rate  initial 
production) .  Tasks  to  be  performed  within  each  phase  must  show 
quality  costs  and  persons  responsible  for  those  identified  tasks 
must  be  held  accountable  through  a  quality  cost  measurement  sys¬ 
tem.  To  accomplish  the  manufacturing  quality  cost  objectives  an 
intense  internal  coordination  and  training  effort  is  necessary. 
Additionally,  the  company  business  planning  function  must  author¬ 
ize  any  increased  scope  as  a  result  of  refined  understanding  of 
requirements  or  additional  Investments/resources  that  may  be 
necessary.  The  business  planning  function  should  be  accountable 
for  reducing  overhead  (burden)  quality  costs  with  manufacturing 
cooperation  and  specific  commitments. 

If  mutual  understanding  of  manufacturing  quality  cost  baselines, 
criteria,  methods  and  objectives  are  in  effect  from  the  very 
beginning  of  a  program,  the  government  and  the  contractor  repre¬ 
sentatives  for  manufacturing  can  manage  their  responsibilities 
for  quality  costs  with  effective  corrective  actions  to  reduce 
total  quality  costs. 

Every  required  task  performed  or  not  performed  by  manufacturing 
has  resultant  cost  of  quality.  Contractual  requirements  and 
program  phase  determine  what  these  tasks  are  and  when  they  are  to 
be  accomplished. 

Some  of  the  more  typical  tasks  or  activities  associated  with 
manufacturing  cost  of  quality  are  listed  below  under  the  cate¬ 
gories  of  Prevention,  Appraisal,  Internal  Failure,  and  External 
Failure. 

Examples  of  Cost  of  Quality  in  Manufacturing 

APPRAISAL  (evaluate,  measure,  or  audit  output) 

Manufacturing  Inspection/Test 

Corrective  Action,  Materietl  Review,  and  Disposition 
Parts  Control  Board 
Statistical  Process  Controls 
Cost  Performance  Reports 
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-  Production  Readiness  Review 

Manufacturing  Perfomance  Measurement 

FAILURE  (determine,  disposition,  rework,  repair,  scrap, 
correct  defective  outputs 

Internal  (before  delivery) 

Internal/Suppller  Scrap  -  Rework  -  Repair 

Rebalance  -  LOB  system 

Improper  Instructions 

Out  of  Station  Work 

Machine,  Tooling,  Equipment  -  Downtime 
Retraining 

External  (after  delivery) 

Field  Failures 
Modification  Expense 

-  Field  Testlng/Repalr/Expense 

-  Operating  Manual  Changes 

Failure  Reporting  -  Corrective  Action  Systems 
Lost  Future  Business 

Prevention  (avoid) 

Manufacturing  Engineering  -  Design  Coordination/ 
Producibility  Analysis 

Risk  Identification/Avoidance 

-  Requirements  Review 

“  Methods,  Equipment,  Processes  Review  -  Industrial 

Engineering 

-  Production  Planning 
Training 
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Table  4-3-1  provides  a  breakdown  of  typical  manufacturing  func¬ 
tions  and  tasks  a  contractor  would  be  expected  to  perform.  The 
applicability  of  tasks  may  be  dictated  by  contractual  require¬ 
ments  and/or  program  phase.  Typical  measures  or  failure  modes  of 
the  quality  effort  are  provided  in  column  five.  To  evaluate 
planned  tasks  one  should  look  for  the  presence  or  absence  of 
manufacturing  tasks  normally  associated  with  cost  of  quality. 
Refer  to  the  examples  in  the  second  and  third  columns  of  table  4- 
3-1  to  help  identify  these  tasks. 

Professional  judgment  concerning  the  resources  (time,  manpower, 
equipment,  facilities)  against  each  task  must  be  applied.  Dis¬ 
cussions  between  government  and  contractor  representatives  will 
be  needed  to  ensure  mutual  understanding.  Evaluation  resulting 
in  either  increases  or  decreases  could  be  judged  appropriate 
dependent  upon  circiimstances.  Quality  costs  must  first  be  viewed 
in  relationships  to  a  task.  Judgment  must  then  include  balancing 
cost  of  quality  with  other  costs  and  ensuring  that  reduction  of  a 
direct  cost  does  not  result  in  an  unplanned  increase  of  indirect 
cost  or  increased  cost  to  another  function.  conversely,  an  in¬ 
creased  manufacturing  quality  cost  may  result  in  unplanned 
decreased  costs  to  another  function  or  to  decreased  overhead 
costs.  Manufacturing  cost  of  quality  must  always  be  categorized 
to  have  functional  meaning/ application  to  manufacturing.  How 
that  feeds  into  cost  centers  and  accounting  conventions  is  yet 
another  problem  that  must  be  resolved,  (e.g.,  how  to  link  the 
manufacturing  data  base  to  the  financial  data  base) . 

Manufacturing  plays  a  key  role  in  ensuring  that  the  product  it 
produces  conforms  to  the  design  consistently  and  correctly  over 
the  life  of  the  product  with  low  production  and  maintenance  cost. 
Cost  of  quality  management  efforts  can  play  a  significant  part  in 
the  successful  accomplishment  of  that  role. 
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COST  OF  QUALITY  FUNCTIONAL  AREA  WORKSHEET 
FUNCTIONAL  AREA  -  MANUFACTURING 


COVERED  BASI 

ACTIVITY  YES  I  NO  PROPOSED  ALLOWED  TRENDS | ACTUALS |  JUDG 


MACHINE,  TOOLING, 
EQUIPMENT  - 
DOWNTIME 

RETRAINING 

MATERIAL 

SUBSTITUTION 

ENGINEERING  CHANGES 

SET  UP  FOR 
REWORK  -  REPAIR 

WRONG  CONFIGURATION 


EXTERNAL  FAILURE 

FIELD  FAILURES 

MODIFICATION 

EXPENSE 

FIELD  TESTING, 
REPAIR,  EXPENSE 

OPERATING  MANUAL 
CHANGES 

FAILURE  REPORTING  - 
CORRECTIVE  ACTION 
SYSTEMS 

LOST  FUTURE 
BUSINESS 

SUPPLIER  ASSISTANCE 

LABORATORY 

TESTING 

SHIPPING  COSTS 
TRAVEL  COSTS 
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FUNCTIONAL  AREA  -  MANUFACTURING 


VERED  BASIS 

YES  NO  proposed  ALLOWED  TRENDS  1  ACTUALS 


ACTIVITY 


PREVENTION 

MANUFACTURING 
ENGINEERING  - 
DESIGN 

COORDINATION/ 

ANALYSIS 

RISK 

IDENTIFICATION  - 
AVOIDANCE 

REQUIREMENTS 

REVIEW 

METHODS,  EQUIPMENT, 
PROCESSES  REVIEW 

PRODUCTION  PLANNING 

TRAINING 

INITIAL  QUALITY 
PLANNING  AND  QIP 

WORK  INSTRUCTIONS 

SAFETY 

REQUIREMENTS 

DETERMINATION  - 
CRITERIA  - 
CHARACTERISTICS 


Finance 


The  financial  and/or  accounting  departments  represent  the  money 
side  of  business  management.  Typically,  the  people  who  work  in 
this  function  are  charged  with  many  responsibilities  which 
include,  but  are  not  limited  to  tracking,  profit  and  loss, 
income,  capital  worth,  cash  flow,  tax  accounting,  cost  accounting 
and  control,  inventory  control,  accounts  payable  and  receivable, 
asset  conservation,  many  forms  of  budgets,  and  financial  policy 
and  forecasting.  Accounting  reports  are  financial  explanations 
of  what  has  happened  in  the  conduct  of  the  company's  business. 
In  the  case  of  budgets  and  some  other  reports,  a  forecast  of  the 
operation  and  conduct  of  the  business  in  the  future  is  being 
generated. 

As  is  the  case  with  other  groups  within  an  organization, 
(e.g., legal  or  computer  operations),  a  language  unique  to  finance 
is  often  used.  The  analyst  should  become  as  familiar  with  the 
terms  and  words  used  by  the  particular  contractor  as  possible. 
The  primary  purpose  in  any  review  of  the  financial  area  is  to 
insure  that  you  fully  understand  what  you  examine  or  are  told. 
You  must  not  only  determine  what  is  explained  by  the  numbers,  but 
also  be  keenly  aware  of  what  can  be  concealed.  It  is  always 
acceptable  to  request  additional  explanation  if  you  do  not  fully 
understand  the  data  or  information  presented. 

Developing  cost  of  quality  in  any  functional  area,  especially  a 
white  collar  area,  will  involve  some  amount  of  judgment  on  the 
part  of  the  analyst.  For  example,  in  business  today,  consider¬ 
able  effort  has  been  directed  toward  reducing  direct  costs  by 
measuring  and  controlling  the  process  that  produces  the  product. 
Meanwhile,  overhead  costs  have  continued  to  increase.  Today  it 
is  likely  to  have  a  condition  where  white  collar  cost  of  quality 
exceeds  cost  of  quality  of  blue  collar  workers.  The  cost  of 
Quality  Functional  Area  Worksheet  which  follows  Table  4-4-1 
provides  some  guidance  to  the  analyst  within  the  financial  area. 
Keep  in  mind,  there  will  probably  be  other  costs  within  each 
category  that  are  specific  to  the  company  under  review.  The 
information  will,  in  many  cases,  not  be  quantifiable  in  dollars 
or  hours  from  actual  data  available.  Judgments  must  be  used 
based  on  observation,  or  the  experience  of  the  analyst.  Use  of 
the  technique  provided  in  Chapter  3  is  recommended.  Examples  of 
cost  of  quality  in  Financial  Management  are: 

Appraisal  (evaluate,  measure,  or  audit  output) 
audits,  financial 
time  and  attendance  review 
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-  accounts  payable  reviews 

-  accounts  receivable  reviews 
invoicing  reviews 
capital  expenditure  reviews 

-  order  entry  and  business  backlog  reviews 

ledger  reviews 

Failure  (determine,  disposition,  rework,  repair,  correct 
defective  output) 

Internal  (before  delivery) 

invoicing  errors 

invoicing  delays 

uncollected  receivables 

-  accounting  errors  corrected 

-  payable  discounts  not  realized 

External  (after  delivery) 

invoicing  errors 

-  payroll  errors 

accounts  payable  errors  -  vendor  relations 
excess  telephone  expense 

premium  expenses,  freight  and  interest,  raw  mater¬ 
ial  ,  prepayment 

Prevention  (avoid) 

education,  internal  training,  and  external  job 
related  training 

budget  preparation 

new  product  cost  and  selling  price  planning 
systems  analysis  and  flow  chart  preparation 
quality  cost  system  development 


The  judgment  required  to  develop  an  informed  opinion  and  conclu¬ 
sion  should  take  into  account  any  quality  costs  that  are  not 
included  in  the  hours  or  dollars  that  are  proposed.  Also  details 
of  planned  tasks  should  be  examined  to  determine  if  costs  in 
excess  of  those  required  are  proposed.  Special  attention  should 
be  paid  to  the  costs  of  Quality  associated  with  contractual 
requirements . 

Table  4-4-1  and  the  worksheet  following  the  table,  should  be  used 
to  facilitate  the  analyst's  review.  The  evaluation  that  is 
developed  will  of  necessity  be  the  result  primarily  of  the 
professional  judgment,  deduction  and  conclusions  of  the  analyst. 
Use  the  methodology  outlined  in  figure  3-3. 
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TO  TO1AL 


MYSOF 
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TRAVEL  MO 


ORDER  ENTRY  SYSTEM  SYSTEM  REVIEW  PREVENTION  -  “  X  OF  ORDERS 

PERTOilWICE  INTERNAL  TRAINING  PROCESSED  TO  TIEC 


MAJOR  RESPONSIBILITY  SPECIFIC  ACTIVITY  COST  OF  QUAUTY  DRIVERS  TYPICAL 
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I  COVERED 

ACTIVITY 


APPRAISAL 
AUDITS.  FINANCIAL 
TIME  AND 

ATTENDANCE  REVIEW 

ACCOUNTS  PAYABLE 
REVIEWS 

ACCOUNTS  RECEIVABLE 
REVIEWS 

INVOICING  REVIEWS 
CAPITAL 

EXPENDITURE  REVIEWS 

ORDER  ENTRY  AND 
BUSINESS  BACKLOG 
REVIEWS 

LEDGER  REVIEWS 


INTERNAL  FAILURE 

INVOICING  ERRORS 

INVOICING  DELAYS 

UNCOLLECTED 

RECEIVABLES 

ACCOUNTING  ERRORS 
CORRECTED 

PAYABLE  DISCOUNTS 
NOT  REALIZED 


FUNCTIONAL  AREA  -  FINANCE 


ACTIVITY 


EXTERNAL  FAILURE 

INVOICING  ERRORS 

PAYROLL  ERRORS 

ACCOUNTS  PAYABLE 
ERRORS  -  VENDOR 
REUTIONS 

EXCESS  TELEPHONE 
EXPENSE 

PREMIUM  EXPENSES, 
FREIGHT  AND 
INTEREST,  RAW 
MATERIAL, 
PREPAYMENT 


PREVENTION 

EDUCATION,  INTERNAL 
TRAINING,  AND 
EXTERNAL  JOB 
RELATED  TRAINING 

BUDGET  PREPARATION 

NEW  PRODUCT  COST 
AND  SELLING  PRICE 
PLANNING 

SYSTEMS  ANALYSIS 
AND  FLOW  CHART 
PREPARATION 

COST  OF  QUALITY 
SYSTEM  DEVELOPMENT 


QUALITY  ASSURANCE 


Quality  Assurance  entails  all  those  functions  required  to 
establish  procedures  and  integrate  program  plans  for  achieving 
and  maintaining  the  required  level  of  product  quality, 
reliability,  and  compliance  with  all  customer  requirements. 
Generally  speaking,  a  quality  organization  will  consist  of 
departments  or  divisions  responsible  for: 

Quality  Administration 

Quality  Engineering 

-  Quality  Operations 

Supplier  Quality 

Metrology/Laboratory  Support 


A  given  quality  organization  will  usually  reflect  some  group 
responsible  for  each  of  these  functions,  although  some  may  be 
combined  with  others.  From  a  cost  of  quality  perspective, 
everything  done  under  the  quality  assurance  function  is  part  of 
the  cost  of  quality.  Many  of  the  activities  are  done  in 
conjunction  with  other  functions,  particularly  engineering  and 
purchasing.  All  activities  will  fall  in  one  of  the  four  major 
cost  of  quality  categories. 

The  first  step  for  the  analyst  is  to  evaluate  the  overall 
proposed  quality  assurance  organization  and  the  functional 
activities  that  are  covered.  Table  4-5-1  can  be  used  as  an  aid, 
for  both  a  generic  list  of  major  responsibilities  and  specific 
activities,  as  well  as  identifying  drivers  from  a  contractual 
requirements  point  of  view.  Questions  to  ask  are: 

Are  there  any  functions  not  covered  by  the  proposed 
system? 

Are  there  any  functions  proposed  that  are  not  needed? 

Are  all  contractual  requirements  covered? 

Is  there  current  evidence,  resulting  from  Contract 
Administration  Service  surveillance,  of  either 
strengths  or  weaknesses  in  the  existing/proposed 
system? 
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The  second  step  is  to  look  at  the  hours  proposed  for  each 
function.  Often  the  contractor  will  project  certain  functional 
hours  as  a  percent  of  some  other  hour  base,  such  as  direct  labor 
hours.  Here  are  some  typical  basis  for  proposed  hours. 


Functional  Hours 
Inspection 


Test 

Quality  Engineering 


Vendor  Quality 


Basis  for  Proposal 
%  of  direct  labor 
direct  inspector  hours 
planned  test  hours 
%  of  direct  labor 
%  of  direct  inspection 
labor 

ratio,  QAEs  to  operators 
projected  lots  shipped 
number  of  suppliers 


Many  of  these  functions  became  level  of  effort  activities  and  it 
is  difficult  to  judge  what  their  level  should  be.  Using  the 
"Interview  -  Job  Breakdown"  technique  described  in  Chapter  three, 
the  evaluator  can  arrive  at  a  estimate  of  the  actual  hours 
required. 


HDL-€t-966aA 


-5-3 


DI-R-5297A/M 


»«yGR  RESI^IBILITY 


4-5-5 


CALmRATEGN  OF  TOOLS/  EST/yJtlSH  RBWU.  SYSTDI 


QI  NQIlJtf  BWl 


TEST  GPERATTON  &  AUDIT  RUN  TESTS  APPRAISAL  MIL-Tl-9B6aA  <SEE  TEST  IHKR 
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FUNCTIONAL  AREA  - 


ACTIVITY 

APPRAISAL 

INSPECTION 

TEST 

MONITOR  TESTS 
SYSTEMS  AUDIT 
DATA  ANALYSIS 
VENDOR  AUDITS 
DESIGN  REVIEWS 


INTERNAL  FAILURE 
CORRECTIVE  ACTION 
MATERIAL  REVIEW 
SCRAP 
REWORK 
REPAIR 


EXTERNAL  FAILURE 

CORRECTIVE  ACTION 

VENDOR  VISITS  TO 
RESOLVE  PROBLEMS 

VENDOR  REJECTS 

DETERMINE  WARRANTY 
COVERAGE 


QUALITY  ASSURANCE 
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FUNCTIONAL  AREA  -  QUALITY  ASSURANCE 


ACTIVITY 

COVE 

:red 

PROPOSED 

ALLOWED 

BASIS 

YES 

NO 

TRENDS 

ACTUALS 

JUDGE 

PREVENTION 

QUALITY  IMPROVEMENT 
PROJECTS 

METROLOGY 

TRAINING 

SUPPLIER 

QUALIFICATION 

TEST  PROOF  OUT 
QUALITY  PLANNING 
QUALITY  ENGINEERING 


Subcontractor  Management 


The  supplier  of  products,  materials,  and  services,  as  well  as 
non-product  services,  can  be  defined  as  the  source  from  which  the 
producer  obtains  many  of  goods  and  services  required  to  operate 
the  company.  The  terms  supplier,  vendor,  seller,  furnisher, 
dealer,  wholesaler,  retailer,  distributor,  and  importer,  among 
others,  are  used,  interchangeably  in  many  areas,  to  describe  the 
source  of  materials  and  services.  Usually  government  contractors 
use  the  terms  vendor,  suppliers,  or  subcontractor.  In  the  case 
of  standard  materials  and  services,  those  which  are  common  and 
have  established  standards,  incoming  inspection  is  typically 
appropriate  for  the  certification  and  assurance  of  conformance. 
This  is  also  generally  applicable  to  minor  components  normally 
built  to  industry  standards,  but  which  may  have  specifications 
from  the  buyer  or  vendor.  The  requirements  differ,  however, 
where  major  products  or  services  are  concerned. 

When  major  procurements  are  made,  a  different  and  more  involved 
relationship  is  required  between  the  prime  contractor  and  the 
subcontractor.  The  materials  in  question  are  typically  sophis¬ 
ticated  and  the  time  frame  for  delivery  and  use  precludes  the 
possibility  of  establishing  a  specification  and  providing  incom¬ 
ing  inspection  at  the  proscibed  delivery  date  to  insure  confor¬ 
mance.  The  buyer  must  establish  a  closer  relationship  with  the 
supplier  to  insure  that  all  aspects  of  the  procurement  are  as 
closely  managed,  almost  as  if  the  product  or  service  were  actual¬ 
ly  made  or  produced  at  the  prime  contractors'  facility  utilizing 
employees  of  the  prime  contractor. 

According  to  J.M.  Juran,  the  establishment  of  the  relationship 
for  major  purchases  may  consist  of  as  many  as  10  particular 
efforts.  They  are: 

1.  Establish  a  vendor  Relations  Q-policy. 

2.  Use  multiple  vendors  for  major  procurements. 

3.  Establish  a  formal  vendor  qualification  process. 

4.  Conduct  joint  quality  planning;  agree  on 
responsibilities . 

5.  Establish  two-way  communication. 

6.  Set  up  to  detect  and  remedy  deviations. 

7.  Conduct  vendor  surveillance. 
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8. 


Exchange  Inspection  data;  provide  certification. 


9.  Under  take  improvement  programs  set  up  material 
assistance. 

10.  Create  and  use  vendor  quality  ratings. 


Not  all  of  these  efforts  will  be  necessary  in  evezry  purchase,  but 
this  listing  can  serve  as  a  checklist.  Judgement  will  be 
required  to  determine  which  of  these  requirements  should  or 
should  not  be  met  and  the  cost  associated  with  the  function.  The 
successful  application  of  these  efforts  toward  excellence  in  the 
product  or  service  delivered  represent  the  subcontract  quality 
responsibility  and  the  costs  associated  will  be  the  subcontract 
cost  of  Quality.  A  major  driver  is  usually  MIL-STD-ISSSA.  Exam¬ 
ples  of  cost  of  quality  in  Subcontractor  Management  are: 

Appraisal  (evaluate,  measure,  an  audit  outputs 

-  product  quality  audits 

-  in  process  and  test  inspection  reviews 

-  manufacturing  instruction  reviews 

-  final  source  inspections 
vendor  rating  system 
combined  MRB  activities 
production  readiness  reviews 


Failure 

Internal  (before  delivery) 
redesign 

engineering  change  requirements 
additional  equipment  requirements 
purchase  contract  amendments 
excess  travel  and  communication  expense 


External  (after  delivery) 
scrap 
rework 

returned  goods  replacement  costs 

reinspection 

retesting 

increased  transportation  expense 

Prevention  (avoid) 

joint  quality  planning 
supplier  quality  systems  reviews 

-  production  risk  assessments 

-  quality  requirements  for  vendor  contract 

-  personnel  training 
packaging  reviews 


Judgement  is  essential  in  the  evaluation  of  the  subcontract  func¬ 
tion.  It  will  seldom  be  possible  to  find  easily  all  costs 
associated  with  the  vendor  relations  and  subcontract  management 
responsibilites.  Following  Table  4-6-1  is  a  cost  of  quality 
functional  Area  Worksheet  which  will  provide  some  examples  of 
activities  that  might  pertain  to  your  evaluation  of  the  function. 
These  do  not  include  all  areas  for  evaluation.  Each  review  will 
have  costs  specific  to  the  business  and  operation  involved.  An 
effort  must  be  made  to  indentify  each  and  apply  hours  or  dollar¬ 
ized  costs  as  required.  In  some  areas  where  hard,  detailed  costs 
have  not  been  accumulated,  or  are  part  of  aggregate  costs  for 
some  other  purpose,  it  will  be  necessary  to  estimate,  observe  or 
calculate  to  determine  the  cost  of  quality  in  question.  When 
interviews  and  observations  are  required  for  making  judgements 
the  Job  Breakdown  Worksheet  (described  in  Chapter  three)  can  be 
helpful.  In  developing  appropriate  quality  costs,  it  is  impor¬ 
tant  to  evaluate  the  activities  individually  and  determine  that 
all  activities  are  included  and  have  not  been  overlooked  or  dis¬ 
counted  and  that  all  costs  presented  are  in  fact  applicable. 
Also,  be  sure  all  contractual  requirements  have  been  included. 
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Conslderedsle  effort  and  expense  has  successfully  been  expended  on 
controlling  quality  in  the  "manufacturing”  cycle.  Recent  experi¬ 
ence  indicates  that  an  equal  or  larger  amount  of  controllable 
quality  costs  are  lodged  with  the  "white  collar"  functions.  In 
fact,  quality  costs  incurred  by  those  who  use  pencils  and  tele¬ 
phones  are  as  significant  as  those  incurred  by  machine  operators 
and  manufacturing  personnel.  Less  effort  and  resource  have  been 
applied  to  recognizing  and  capturing  the  cost  of  quality  in  the 
white  collar  functions,  but  it  is  clear  that  process  control  for 
business  processes,  such  as  vendor  review  programs  or  delivery 
schedule  reviews  in  the  subcontract  management  function,  can  be 
successfully  applied. 
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FUNCTIONAL  AREA  -  SUBCONTRACT  MANAGEMENT 


ACTIVITY 


APPRAISAL 

PRODUCT  QUALITY 
AUDITS 

IN  PROCESS  AND 
TEST  INSPECTION 
REVIEWS 

MANUFACTURING 
INSTRUCTION  REVIEWS 

FINAL  SOURCE 
INSPECTIONS 

VENDOR  RATING 
SYSTEM 

COMBINED  MRB 
ACTIVITIES 


INTERNAL  FAILURE 
REDESIGN 

ENGINEERING  CHANGE 
REQUIREMENTS 

ADDITIONAL 

EQUIPMENT 

REQUIREMENTS 

PURCHASE  CONTRACT 
AMENDMENTS 

EXCESS  TRAVEL  AND 

COMMUNICATION 

EXPENSE 


COVERED  _  BASIS _ 1 

YES  I  NO  proposed  ALLOWED  TRENDS  I  ACTUALS !  JUDGE! 
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FUNCTIONAL  AREA  -  SUBCONTRACT  MANAGEMENT 


ACTIVITY 


EXTERNAL  FAILURE 
SCRAP 
REWORK 

RETURNED  GOODS 
REPLACEMENT  COSTS 

REINSPECTION 

RETESTING 

INCREASED 

TRANSPORTATION 

EXPENSE 


PREVENTION 

JOINT  QUALITY 
PLANNING 

SUPPLIER  QUALITY 
SYSTEMS  REVIEWS 

QUALITY 

REQUIREMENTS  FOR 
VENDOR  CONTRACT 

PERSONNEL  TRAINING 

PACKAGING  REVIEWS 


LOGISTICS 


Logistics  is  an  integral  part  of  the  acquisition  of  any  new  wea¬ 
pon  system.  The  system's  support  must  be  integrated  into  the 
development  process,  so  the  term  Integrated  Logistics  Support 
(ILS)  refers  to  the  management  and  analysis  actions  necessary  to 
assure  effective  and  economical  support  of  a  material  system, 
both  during  the  various  phases  of  development  through  deployment 
and  disposition. 

Specific  areas  must  be  considered  in  accomplishing  the  ILS  pro¬ 
cess.  DoD  Direct  5000.39  defines  nine  (9)  elements  of  ILS  as 
follows: 

Maintenance  Plan 

Manpower  and  Personnel 

Supply  Support 

Support  and  Test  Equipment 

Training  and  Training  Devices 

Technical  Data 

Computer  Resource  Support 

Packaging,  Handling,  Storage,  and  Transportation 
Facilities 


The  contractor  will  normally  be  tasked  with  the  requirement  to 
perform  Logistics  Support  Analysis  (LSA)  as  the  formal  process  of 
examining  the  weapon  system  and  ensuring  that  all  the  logistics 
support  elements  are  considered.  Government  decisions  regarding 
the  maintenance  concept  are  critical  to  determining  the  nature  of 
a  majority  of  the  other  elements.  The  maintenance  plan  tends  to 
drive  all  the  other  elements. 

The  government's  ILS  plan  will  provide  specific  task  oriented 
guidance  to  the  contractor  regarding  what  must  be  done  to  plan 
for  and  adequately  cover  the  nine  ILS  elements.  Typical  activi¬ 
ties  are: 

Maintenance  Concept  Analysis 

Lessons  Learned  Review 


Develop  Maintenance  Allocation  Chart 
Technology  Assessment 


Built  in  Test 
Automated  Test  Equipment 
System  Diagnostics 
Organic  versus  Commercial  Support 
Deployment  Analysis 
Facilities  Requirements  Analysis 
Training  Analysis 


The  nature  of  these  tasks,  relative  to  their  output,  changes  as 
the  program  moves  through  the  various  phases  of  the  acquisition 
process  (see  table  3-1) .  Generally  the  activity  moves  from  anal¬ 
ysis,  to  initial  recommendations,  to  firm  commitment  to  a  given 
support  approach,  resulting  in  actions  to  provide  the  needed 
resources  (equipment,  parts,  training,  facilities,  etc.}* 
Throughout  the  entire  process,  cost  of  quality  will  be  incurred. 
Examples  of  these  costs  are  given  below. 

Appraisal  (evaluate,  measure,  or  audit  output) 

ILS  milestone  progress  review 

Individual  LSA  analyses  review 

Equipment  design  review 

Facilities  plan/design  review 

Technical  data  review 

Training  material  review 


Failure  (detection,  disposition,  rework,  repair,  scrap,  correct 
nonconforming  output) 

Internal  (before  delivery) 

Planning  errors 

LSA  analysis  not  complete 

LSA  analysis  errors 


Facility  power  requirements  not  covered 
Technical  training  requirements  overlooked 
Technical  data  schematic  errors 


External  (after  delivery) 

Errors  in  plan  submitted  to  government 

Errors/omission  from  LSA  documents 

Sneak  circuit  in  test  equipment 

Facility  met  the  design,  but  is  inadequate 

Technical  order  errors  (typos,  omissions,  incorrect 
logic  in  trouble  tree,  etc.) 

Training  not  current  with  latest  configuration  of 
equipment 

Prevention  (avoid) 

Training  of  LSA  analysts 
Up  front  planning 
Development  of  handbooks 

Debug/proofing  of  computer  models  prior  to  actual  use 
in  LSA  effort 

Review  of  lessons  learned 


Now  look  at  table  4-7-1  for  a  detailed  breakout  of  typical  major 
responsibilities,  activities,  drivers,  and  cost  of  quality  mea¬ 
sures  for  the  logistics  area.  A  worksheet  to  assist  in  capturing 
cost  of  quality  is  also  provided. 


4-7-3 


USER  INWLVED  UP 


COST  OF  QUALITY  FUNCTIONAL  AREA  WORKSHEET 
FUNCTIONAL  ArIa”^  LOGISTICS 


ACTIVITY 


EXTERNAL  FAILURE 

ERRORS  IN  PLAN 
SUBMITTED  TO 
GOVERNMENT 

ERRORS/OMISSION 
FROM  LSA  DOCUMENTS 

SNEAK  CIRCUIT  IN 
TEST  EQUIPMENT 

FACILITY  MET  THE 
DESIGN,  BUT  IS 
INADEQUATE 

TECHNICAL  ORDER 
ERRORS  (TYPOS, 
OMISSIONS,  INCOR¬ 
RECT  LOGIC  IN 
TROUBLE  TREE,  ETC.) 


TRAINING  NOT 
CURRENT  WITH 
LATEST  CONFIGUR¬ 
ATION  OF  EQUIPMENT 


PREVENTION 

TRAINING  OF  LSA 
ANALYSTS 

UP  FRONT  PLANNING 

DEVELOPMENT  OF 
HANDBOOKS 

DEBUG/PROOFING  OF 
COMPUTER  MODELS 
PRIOR  TO  ACTUAL 
USE  IN  LSA  EFFORT 

REVIEW  OF  LESSONS 
LEARNED 


CONTRACTS 


The  contracts  function  makes  a  very  substantial  contribution  to 
the  cost  of  quality.  Although  the  responsibilities  of  the  con¬ 
tracts  organization  will  probably  vary  from  contractor  to  con¬ 
tractor,  it  generally  is  the  primary  legal  link  to  the  govern¬ 
ment.  Through  the  contract,  the  terms  and  conditions,  specifi¬ 
cations,  tasking  and  financial  aspects  of  the  contractor  - 
government  relationship  become  binding  on  both  parties.  The 
effect  of  errors  in  any  of  these  elements  can  have  a  direct 
financial  impact  on  both  parties.  A  list  of  typical  functions 
performed  by  contracts  might  look  like  this: 

Proposal  Preparation 

Pricing 

Negotiation 

Contract  Administration 
Invoice/Progress  Payment  Submission 


Although  these  functions  may  not  always  be  performed  by  the  con¬ 
tracts  organization,  they  represent  the  range  of  functions  that 
could  be  performed  there. 

By  the  very  nature  of  these  functions,  extensive  interaction  with 
other  areas  is  required  in  order  to  convert  the  government ' s 
request  for  proposal  (RFP)  into  a  profitable  contract  that  meets 
the  customer's  requirements.  Since  contracts  is  generally  the 
final  link  in  the  chain  which  establishes  the  legal  relationship 
with  the  government,  its  contribution  to  the  cost  of  quality  can 
be  significant.  Errors  committed  in  the  pricing  and  negotiation 
of  the  contract  are  not  easily  remedied. 

Following  is  a  list  of  activities  which  become  part  of  the  cost 
of  quality. 

Prevention 


Training  (administrative,  technical,  and  management) 
Development  of  handbooks  and  aids  to  job  performance 
Development  of  plans  and  strategy 

Team  meetings  and  effective  communication  of  plans  and 
strategies 


Appgfljgal 


Reviews  of  documents  and  negotiation  positions 
Reviews  of  compliance  with  requirements 
Audits  of  pricing  accuracy 
Reviews  of  siabmissions  to  the  government 

Internal  Failure 

Errors  in  preparation  of  documents 
Negotiation  errors 

Failure  to  meet  internal  milestones 
External  Failure 

Inaccurate  or  incomplete  proposals  or  contracts 

-  Late  proposals  or  contract  submittals 
Defective  pricing 

-  Incorrect  submissions 


Contract  and  correspondence  files  are  good  sources  of  information 
on  external  failures.  Records  relating  to  proposal  activity  may 
indicate  where  internal  failures  occurred  during  preparation  of 
proposals.  Requests  for  clarification  or  notices  of  deficiencies 
in  proposals  will  indicate  external  failures.  Depending  on  where 
such  information  is  found,  rejected  progress  payment  requests, 
corrected  requests,  and  rejected  and  corrected  invoices  will  also 
indicate  external  failure.  Additional  information  can  always  be 
obtained  through  interviews  with  persons  involved  with  these 
activities.  Table  4-8-1  describes  the  major  responsibilities, 
activities  and  cost  of  quality  for  the  contracts  function.  A 
guide  for  analysis  of  the  cost  of  quality  is  provided  by  the 
functional  area  worksheet.  It  is  not  meant  to  be  all  inclusive, 
but  is  a  starting  poinc  and  must  be  adapted  to  each  organization 
evaluated. 
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COST  OF  QUALITY  FUNCTIONAL  AREA  WORKSHEET 
FUNCTIONAL  AREA  -  CONTRACTS 


ACTIVITY 


APPRAISAL 

PRE  NEGOTIATION 
REVIEWS 

CONTRACT  DOCUMENT 
REVIEW 

CHECK  PROPOSAL  VS. 
RFP 

CHECK  FOR  PRICING 
ERRORS 

CHECK  FOR  CURRENT 
PRICING  DATA  NOT 
SUBMITTED 

REVIEW  STATUS  OF 

CONTRACT 

DELIVERABLES 

COMPARE  ACTUAL  AND 
REQUIRED  DELIVERY 
DATES 

CHECK  INVOICES/ 
PROGRESS  PAYMENT 
REQUESTS  FOR 
ACCURACY 


INTERNAL  FAILURE 

PROPOSAL  ERRORS 
PRIOR  TO  SUBMISSION 

NEGOTIATION  ERRORS 

CONTRACT  ERRORS 
PRIOR  TO 
SIGNATURE 

INVOICE/PROGRESS 
PAYMENT  ERRORS 
DUE  TO  SUBMISSION 


VERED 

YESi  NO  proposed  ALLOWED  |trenDS 


COST  OF  QUALITY  FUNCTIONAL  AREA  WORKSHEET 


FUNCTIONAL  AREA  -  ( 


ACTIVITY 


EXTERNAL  FAILURE 

PROPOSAL  ERRORS 
AFTER  SUBMISSION 

POST  AWARD  AUDIT 
REPORTS 

(DEFECTIVE  PRICING) 

CORRECTIONS  TO 
CONTRACTS 

CLAIMS 

UWSUITS 

LATE  PROPOSALS 

REJECTED  OR  DELAYED 
PROGRESS  PAYMENT 
REQUESTS 

REJECTED  INVOICES 
OR  DELAYED  PAYMENT 


PREVENTION 

TRAINING 

DEVELOP  HANDBOOKS, 
CHECKLISTS,  AND 
GUIDES 

PROPOSAL/ 
NEGOTIATION 
MEETINGS  AND  PLANS 

COORDINATION  OF 

NEGOTIATION 

POSITION/STRATEGY 


CONTRACTS 


VERED 


BASIS 

TRENDS 

ACTUALS 

JUDGE 
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Programs  which  call  for  cost  and  schedule  reporting  as  a  contrac¬ 
tual  requirement  provide  a  ready  source  for  first,  getting  visi¬ 
bility  into  specific  costs  of  quality,  and  second,  monitoring 
those  expenditures.  Looking  at  the  way  that  the  contractor  typi¬ 
cally  generates  the  cost  data,  it  is  obvious  that  referring  to 
the  individual  work  packages  is  one  step  toward  finding  readily 
available  cost  data  (figure  5-1). 
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Work  packages  constitute  the  basic  building  blocks  used  by  the 
contractor  in  planning,  controlling,  and  measuring  contract  per¬ 
formance.  In  addition,  if  the  contractor  has  established  cost 
accounts,  at  a  level  just  above  work  packages  in  his  contractor 
work  breakdown  structure,  then  detailed  costs  from  both  a  pro¬ 
posed  and  actual  view  may  be  available.  Keep  in  mind  that  all 
direct  costs  are  accumulated  in  cost  accounts.  Current  criteria 
do  not  require  recording  of  indirect  costs  at  this  level.  How¬ 
ever,  overhead  pools  and  corresponding  budgets  must  be  designated 
and  the  methods  used  for  allocation  clearly  defined  and 
documented.  Unfortunately,  level  of  effort  work  has  no 
established  criteria  for  determination  of  acceptable  levels. 
Often  we  find  that  the  work  involved  with  cost  of  quality  is 
level  of  effort.  For  example: 

Engineering 

FRACAS 

Quality 

QA  Engineering  problem  solving 


Once  cost  analysis  has  been  performed  and  the  costs  proposed  have 
been  evaluated,  the  negotiations  completed,  and  a  contract 
awarded,  performance  against  the  budget  is  tracked.  From  a  cost 
of  quality  point  of  view,  we  are  concerned  that  the  costs 
expended  produce  the  desired  results.  The  desired  results  are 
achievement  of  the  contractual  quality  requirements,  that  is,  the 
establishment  and  implementation  of  an  effective  and  efficient 
quality  program.  Effectiveness  is  measured  by  the  performance 
indication  discussed  in  Chapter  one  and  outlined  in  table  1-4. 
The  trends  must  reflect  that  the  quality  effort  is  achieving  an 
acceptable  level  of  quality  and  is  improving  that  level  over 
time.  Each  functional  analyst's  professional  judgment  must  be 
applied  to  determine  the  acceptability  of  the  level  of  budgeted 
resources.  Efficiency  is  measured  by  whether  the  resources 
being  expended  are  the  optimum  for  the  results  achieved. 

Focus  must  be  placed  on  analysis  of  variances  that  occur  between 
budgeted  and  actual  costs  over  the  life  of  the  contract.  If 
quality  performance  indicators  are  high,  or  trends  are  up,  the 
analyst  must  verify  that  the  planned  resources,  assuming  analysis 
showed  their  level  to  be  correct,  are  indeed  being  applied. 
Using  the  techniques  and  worksheets  described  in  each  of  the 
individual  functional  sections  in  Chapter  five  is  the  next  step. 

Programs  covered  by  MIL-STD-1567A,  Work  Measurement,  offer 
another  source  of  data  that  is  useful  in  cost  of  quality  anal¬ 
ysis.  The  essence  of  work  measurement  can  be  summed  up  in  the 
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concepts  of  variance  analysis  and  methods  improvement.  Once 
engineered  standards  have  been  established  for  work  performed, 
analysis  of  those  variances  that  occur  from  the  standard  should 
be  aimed  at  finding  and  eliminating  the  cause  of  the  variance. 
If  the  contractor's  actuals  show  a  consistent  performance  level 
above  the  standard  hour  content,  the  variance  allowance  can 
reveal  cost  of  quality  contribution.  For  example,  is  the  process 
so  difficult  to  control,  to  ensure  that  it  produces  conforming 
product,  that  extra  care  and  time  is  needed  by  the  operator,  thus 
causing  the  variance  from  standard?  This  is  a  prevention  cost 
contributor.  If  the  variance  is  due  to  excessive  rework  or 
repair  action,  this  is  a  failure  cost  contributor.  Looking  at 
the  variance  analysis  can  be  very  helpful  when  doing  cost  of 
quality  analysis.  In  addition,  if  the  contractor  puts  into  place 
methods  improvements,  besides  the  expected  benefit  of  lowering 
the  standard,  the  result  may  well  be  a  more  capable  and 
controllable  process.  Contribution  to  the  prevention  of  errors 
is  evident.  The  initial  investment,  or  a  portion  thereof,  can 
be  legitimately  counted  as  a  cost  of  quality.  Training  of  oper¬ 
ators,  both  to  better  control  the  old  process,  or  properly  imple¬ 
ment  the  new  methods,  is  also  prevention  cost  of  quality. 


In  its  present  form,  MIL-Q-9858A,  paragraph  3.6,  which  clearly 
establishes  the  requirement  for  collecting  and  making  available 
cost  of  quality  data,  is  subject  to  a  good  deal  of 
interpretation.  As  discussed  under  requirements  in  Chapter  two, 
pages  2-6  and  2-7,  even  the  government's  interpretation  has  sent 
a  message  to  contractors  that  FAILURE  costs  associated  with 
scrap,  rework,  and  repair  are  the  only  costs  actually  required. 
Turning  to  MIL-STD-1520C,  the  requirement  also  is  specific  on 
failure  cost,  but  leaves  selection  of  "other  costs  as  determined 
appropriate  by  the  contractor".  At  this  time,  the  best  way  to 
obtain  the  desired  cost  of  quality  effort  on  the  part  of  a  con¬ 
tractor,  assuming  he  is  not  willing  to  adopt  a  wider  interpreta¬ 
tion  of  existing  requirements,  is  through  specific  contractual 
language. 


There  are  several  approaches  that  could  be  used  when  considering 
how  to  both  obtain  the  desired  results  and  to  positively  motivate 
the  contractor  to  perform  in  the  manner  that  maximizes  benefits 
of  using  cost  of  quality  as  a  management  tool.  Request  for  pro¬ 
posal  instructions  to  offeror  must  provide  proper  emphasis. 
After  investigating  various  options,  the  methods  recommended  here 
consist  of  suggested  contractual  clauses,  statement  of  work  pro¬ 
visions,  or  combinations  of  both.  It  is  generally  agreed  that 
profit  is  an  effective  motivator.  Offering  a  contractor  an  award 
fee,  based  on  performance  in  the  cost  of  quality  management  area, 
then  becomes  one  approach.  Getting  a  contractor  into  a  "preven¬ 
tion  mode"  will  have  significant  benefits  for  the  life  cycle 
costs  of  his  product,  and  would  more  than  offset  the  cost  of  the 
award  fee.  Making  the  fee  a  portion  of  the  profit  allowed  on  the 
contract  then  ties  it  to  the  normal  cost  experienced  by  the 
government,  as  opposed  to  an  "over  and  above"  amount.  But 
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offering  an  over  and  above  eimount  could  also  enhance  the  motiva¬ 
tional  effectiveness  of  the  fee.  Obviously,  it  Increases  the 
initial  cost  to  the  government,  but  again,  the  overall  reduction 
in  life  cycle  costs  will  more  than  offset  this  front  end 
Increase.  In  addition,  the  total  cost  of  quality,  as  discussed 
in  Chapter  one,  figure  1-15,  will  decrease  as  the  contractor  gets 
into  the  prevention  mode,  thus  offsetting  the  cost  of  any  award 
fee. 

What  follows  are  examples  of  "suggested"  contract  clauses,  and 
statement  of  work  provisions.  Appendix  E  provides  copies  of 
actual  award  fee  wording  from  two  contracts  used  in  Air  Force 
programs.  The  program  identifying  characteristics  have  been 
removed  from  each  example.  A  logical  consideration  to  follow  an 
award  fee  program,  designed  to  get  the  contractor's  management 
focus  on  moving  towards  a  prevention  mode,  would  be  a  shared 
savings  program.  Approaches  currently  used  in  the  industrial 
modernization  incentive  program  could  be  modified.  Once  the 
focus  was  on  prevention,  the  reductions  obtained  in  the  cost  of 
quality  total  could  then  be  shared.  The  share  approach  could 
take  a  variety  of  forms,  and  could  be  tied  to  other  factors  such 
as  improving  reliability  and/or  reduction  in  field  failures. 
Total  cost  of  quality  can  run  anywhere  from  10%  to  30%  of  sales, 
so  shared  reductions  represents  a  significant  amount  of  money. 

SUGGESTED  CONTRACTUAL  CLAUSES 

In  order  to  ensure  that  the  contractor  captures  cost  of  quality 
in  all  the  categories,  i.e.,  prevention,  appraisal,  and  internal 
and  external  failure,  the  following  clauses  are  suggested. 


CLEAR  DEFINITION  OT  COST  OF  QUALITY  DATA 

"Cost  of  Quality.  For  the  purposes  of  this  contract,  the  con¬ 
tractor  shall  capture  cost  of  quality  under  MIL-Q-9858A,  para¬ 
graph  3.6  in  a  manner  which  segregates  the  cost  for  prevention  of 
defective  output  and  the  correction  of  defective  output  (to  be 
referred  to  as  failure  costs).  Under  paragraph  3.4,  the  contrac¬ 
tor  shall  capture  the  costs  associated  with  the  effort  expended 
to  generate  the  quality  information  for  which  records  are 
required,  i.e.,  the  appraisal  of  the  processes  which  result  in 
the  final  product.  These  costs  shall  be  made  available  under 
authority  of  paragraph  3.6.  The  requirement  for  prevention  and 
correction  costs  is  clearly  stated  in  paragraph  3.6.  Costs 
associated  with  appraisal  activity  necessary  to  produce  the 
records  of  quality  status  essentially  represent  the  costs  associ¬ 
ated  with  the  quality  department  inspection,  audit,  and  test 
resources.  Under  authority  of  paragraph  3.5,  these  costs  of 
quality  will  be  used  by  the  contractor  as  a  management  tool  to 
assist  in  exercising  responsibilities  for  detection,  correction 
of  assignable  causes  across  the  entire  organization  as  well  as  at 
suppliers,  trend  analysis  aimed  at  prevention,  and  monitoring  of 
the  effectiveness  of  corrective  action". 


INCLUSION  Of  SPECIFIC  REQUIREMENTS  DRIVING  COST  QZ  QUALITY 


"Beyond  requirements  covered  under  MIL-Q-9858A,  the  contractor 
shall  segregate  all  costs  associated  with  the  following  efforts, 
as  applicable,  and  include  these  costs  as  part  of  his  cost  of 
quality  management  program: 


MIL-STD-1520C 

MIL-STD-45662 

MIL-STD-1535A 

*MIL“STD-1567A 

*MIL-STD-1528A 

MIL-STD-100 

MIL-STD-810D 


Correction  of  Non-Conforming  Material 
Metrology 

Control  of  Subcontractor  quality 
Work  Measurement 
Manufacturing  Management 
Engineering  Drawings 
FRACAS/ FME A 

Environmental  Stress  Screening 
Hardware  Quality  Audit 
Statistical  Process  Control 


*Only  the  costs  of  collecting  data,  evaluating  it,  and  act¬ 
ing  to  correct  and  prevent  problems.  Does  not  include  cost 
of  establishing  the  work  measurement  or  manufacturing 
management  program. 

These  costs  shall  include  effort  expended  by  all  functions 
associated  with  the  accomplishment  of  the  specific  tasks  driven 
by  these  government  specif ications/ standards. " 

STATEMENT  OF  WORK  PROVISION 

If  the  use  of  either  of  these  suggested  clauses  is  not  suitable, 
another  option  would  be  to  specify  what  is  required  in  the  state¬ 
ment  of  work. 
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STATEMENT  OF  WORK 


CQSI  2£  QUALITY  PROGRAM.  The  contractor  shall  establish  a  Cost 
of  Quality  Program  for  each  business  unit  performing  work  under 
this  contract.  The  purpose  is  to  provide  management  tools  to 
enable  the  contractor  to  move  from  a  reactive  "find  and  fix" 
quality  mode  to  a  "preventative**  mode.  The  contractor  shall 
comply  with  the  provisions  of  Annex  .  (DI-X-XXXX 
(Plan) )  and  (DI-X-X-XXXX  (COQ  Report) ) . 


ANNEX 


COST  OF  QUALITY 


Purpose.  The  purpose  of  this  annex  is  to  specify  the  general 
program  and  requirements  for  the  Cost  of  Quality  Program. 


Scope. 


Introduction.  The  traditional  view  of  the  Cost  of  Quality  is 
focused  on  the  costs  of  scrap,  rework  and  repair  or  more  correc¬ 
tly,  the  cost  of  failure.  By  viewing  only  the  costs  of  failure, 
this  traditional  approach  has  prevented  us  from  identifying  the 
true  cost  of  quality  and,  therefore,  has  not  helped  to  identify 
the  root  causes  of  poor  quality.  A  more  useful  approach  to  the 
cost  of  quality  considers  not  only  the  cost  of  failure,  but  also 
the  costs  of  appraisal  and  prevention.  Additionally,  failure 
costs  are  subdivided  into  external  failures  and  internal 
failures.  Cost  of  quality  is  one  of  the  management  tools  avail¬ 
able  for  use  in  improving  the  overall  quality  of  the  goods  and 
services  purchased  by  the  Department  of  the  Air  Force.  Speci¬ 
fically,  it; 

provides  visibility  into  the  total  cost  of  ensuring 
quality  requirements  are  being  met. 

-  points  to  problems  in  the  quality  program  that  are 
reflected  in  cost  of  quality  category  imbalances,  or 
excessive  cost  in  non-value  added  activities. 

acts  as  a  diagnostic  tool  at  lower  organizational 
levels  in  identifying  problem  areas. 

allows  judgments  about  the  real  thrust  of  a  given 
effort  to  achieve  quality  from  the  perspective  of 
"inspecting  quality  in"  versus  "designing  and  building 
quality  in". 

allows  management  to  judge  the  effectiveness  of  correc¬ 
tive  actions  taken  to  eliminate  the  root  causes  and 
improve  product  quality. 


Definitions. 

a.  Output  -  result  or  tangible  product  of  any  process 

(design,  purchasing,  manufacturing,  etc.) 


b.  Cost  of  Quality  -  the  cost  of  all  efforts  expended  to 
find  non-conforming  output,  react  to  actual  failures, 
both  internally  and  externally,  and  to  prevent  failures 
from  happening  in  the  first  place. 

c.  Appraisal  Costs  -  costs  expended  in  the  effort  to  find 
non-conforming  output.  (See  Page  1-1,  this  handbook.) 

d.  Failure  Costs  -  the  cost  of  actual  failures  themselves 
are  called  internal  failure  and  external  failure  costs. 

e.  Prevention  Costs  -  the  cost  of  efforts  designed  to  stop 
problems  or  failures  from  occurring  in  the  first  place. 


Implementation  Plan.  The  contractor  shall  develop  a  cost  of 
quality  implementation  plan  covering  each  major  business  unit 
performing  work  under  this  contact. 

Purpose.  The  purpose  of  the  implementation  plan  is 
threefold  - 

1.  Promote  a  Cost  of  Quality  culture  within  the  organiza¬ 
tion.  This  culture  is  built  on  the  recognition  that 
everyone  in  the  organization  contributes  to  the  ulti¬ 
mate  quality  of.  the  organization's  output  and  that  the 
customers  defines  quality. 

2.  Define  the  Cost  of  Quality  for  the  organization  and 
the  system  designed  to  capture  it. 

3 .  Assign  tasking  for  overall  management  of  the  plan  as 
well  as  for  the  actual  collection  of  the  cost  of  qual¬ 
ity  data. 

Specific  Requirements 

1.  The  plan  shall  be  unique  to  the  contractor  so  as  to  be  read¬ 
ily  used  by  management  of  each  affected  organizational  ele¬ 
ment. 

2.  Although  the  plan  will  be  unique,  it  should  be  tailored 
along  the  lines  of  accepted,  existing  programs  such  as  the 
American  Society  for  Quality  Control's  "Principles  of  Qual¬ 
ity  Cost" . 

3.  The  plan  must  identify  the  cost  of  quality  by  identifying 
and  listing  all  quality  related  activities  under  the  general 
categories  of  Prevention,  Appraisal,  Internal  Failure,  and 
External  Failure. 
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4.  The  plan  must  describe  how  the  costs  of  these  quality  rela¬ 
ted  activities  will  be  captured  and  reported. 

5.  The  plan  must  also  describe  how  management  will  use  the 
reported  information  to  move  from  the  traditional  "find  and 
fix"  reaction  mode  to  one  of  "prevention" . 


Measures . 


The  final  section  of  the  implementation  plan  shall  establish 
measures,  in  terms  of  cost  of  quality,  which  will  document  the 
progress  in  moving  toward  a  totally  "preventative"  quality 
environment.  Improvement  indicated  by  these  measures  must  be 
verifiable  by  the  contracting  officer  with  the  assistance  of  the 
CAO  and/or  DCAA.  (Note:  Use  caution  If  "goals"  are  proposed. 
Merely  achieving  cost  reductions  is  not  the  primary  intent  of 
capturing  cost  of  quality  data.) 

Award  Fee. 

Because  of  the  importance  of  high  quality  in  the  goods  and 
services  purchased  by  the  Department  of  the  Air  Force,  the 
government  may,  in  selected  instances,  incentivize  a  contractor's 
management  of  the  cost  of  quality  through  use  of  an  Award  Fee 
provision. 

Specifications  and  Standards. 

MIL-Q-9858A 

MIL-STD-1520C 

MIL-STD-1535A 

MIL-STD-1567A 

MIL-STD-1528A 
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GLOSSARY  OF  TERMS 


ACCEPTANCE  -  The  act  of  an  authorized  representative  of  the 
government  by  which  the  government  assumes  for  itself,  or  as 
agent  of  another,  ownership  of  existing  and  identified  supplies 
tendered  or  approves  specific  services  rendered,  as  partial  or 
complete  performance  of  the  contract  on  the  part  of  the 
contractor. 

ACTUAL  COST  -  The  sura  of  the  allowable  direct  and  indirect  costs 
(allocable)  incurred  as  a  result  of  producing  a  part,  product,  or 
service. 

BASELINE  COST  ESTIMATE  (BCE)  -  A  document  which  is  a  deliberate 
detailed  estimate  of  acquisition  and  ownership  costs. 

CALIBRATION  -  The  comparison  of  a  measurement  system  or  device  of 
unverified  accuracy  to  a  measurement  system  or  device  of  known  or 
greater  accuracy  to  detect  and  correct  any  variation  from 
required  performance  specifications  of  the  unverified  measurement 
system  or  device. 

CONFIGURATION  -  The  functional  and/or  physical  characteristics  of 
hardware/computer  programs  as  set  forth  in  technical  documenta¬ 
tion  and  achieved  in  a  product. 

COST  CENTER  -  Any  subdivision  of  an  organization  comprised  of 
workers,  equipment  areas,  activities,  or  combination  of  these 
that  is  established  for  the  purpose  of  assigning  or  allocating 
costs.  Cost  centers  are  also  used  as  a  base  for  perforraance 
standards.  Synonym:  burden  center,  cost  pool. 

COST  ESTIMATING  RELATIONSHIP  (CER)  -  The  curve  of  a  cost  function 
which  relates  the  cost  of  a  product  to  some  measurable  character¬ 
istic  of  its  manufacture  and  from  which  extrapolations  and  inter¬ 
polations  may  be  extracted  for  estimating  purposes. 

COST  OF  QUALITY  -  The  costs  of  all  efforts  expended  to  find  non- 
conforming  output  ,  react  to  actual  failures,  both  internally  and 
externally,  and  to  prevent  failures  from  happening  in  the  first 
place. 

Appraisal  Costs  -  The  costs  expended  in  the  effort  to  find 
non-conforming  output. 

Prevention  Costs  -  The  costs  of  efforts  designed  to  stop 
problems  or  failures  from  occurring. 

Internal  Failure  Costs  -  The  costs  incurred  for  identified 
failures  prior  to  final  delivery  of  the  specific  output  to 
the  customer. 


External  Failure  Costs  -  The  costs  incurred  for  a  specific 
output  that  fails  after  delivery  to  the  customer. 

CRITICAL  WEAKNESS  RELIABILITY  TEST  -  This  test  determines  the 
mode  of  failure  when  equipment  is  exposed  to  environments  in 
excess  of  the  anticipated  environments.  By  this  testing,  criti¬ 
cal  levels  can  be  determined  from  vibration,  temperature  voltage, 
cycles,  etc.,  which  will  adversely  affect  the  component.  In 
subsequent  tests  of  the  total  system  in  which  a  stress  level 
exceeds  the  expected  limits,  an  evaluation  of  the  critical  weak¬ 
ness  tests  will  provide  excellent  insight  as  to  what  may  have 
been  damaged  or  what  can  be  expected  to  fail. 

DEMONSTRATION  VALIDATION/RISK  REDUCTION  -  The  period  when  major 
program  characteristics  are  refined  through  extensive  study  and 
analysis,  hardware  development,  test  and  evaluations.  The  objec¬ 
tive  is  to  validate  the  choice  of  alternatives  and  to  provide  the 
basis  for  determining  whether  or  not  to  proceed  into  full-scale 
development. 

DESIGN  TO  COST  -  A  process  utilizing  unit  cost  goals  as 
thresholds  for  managers  and  design  parameters  for  engineers 
normally  in  terms  of  a  single  cumulative  "average  flyaway  cost". 
This  cost  represents  what  the  government  has  determined  it  can 
afford  to  pay  for  a  unit  of  military  equipment  which  meets 
established  and  measurable  performance  requirements  at  a  speci¬ 
fied  production  quantity  and  rate  during  a  specified  period  of 
time. 

DESIGN  TO  COST  GOAL  -  A  specific  cost  established  as  a  goal  for  a 
specific  configuration,  established  performance  characteristics 
and  a  specific  number  of  systems  at  a  defined  production  rate. 

DIRECT  COST  -  Those  costs  which  can  be  traced  directly  to  a 
specific  piece-part,  subassembly,  or  product. 

DIRECT  ENGINEERING  -  Engineering  effort  directly  traceable  to  the 
design,  manufacture,  or  control  of  specific  end  products. 

DIRECT  LABOR  STANDARD  -  A  specified  output  or  a  time  allowance 
established  for  a  direct  labor  operation. 

DIRECT  MANUFACTURING  LABOR  -  Work  which  alters  the  composition, 
condition,  conformation,  or  construction  of  the  product;  the  cost 
of  which  can  be  identified  with  and  assessed  against  a  particular 
part,  product,  or  group  of  parts  or  products  accurately  and  with¬ 
out  undue  effort  and  expense;  coloquially  called  "direct  labor". 

DIRECT  MATERIAL  -  All  material  that  enter  into  and  becomes  part 
of  the  finished  product  (including  waste) ,  the  cost  of  which  can 
be  identified  with  and  assessed  against  a  particular  part, 
product,  or  group  of  parts  or  products  accurately  and  without 
undue  effort  and  expense. 


EFFICIENCY  FACTOR  -  The  ratio  of  standard  performance  time  to 
actual  performance  time,  usually  expressed  as  a  percentage. 

FAILURE  -  The  event  in  which  any  part  of  an  item  does  not  perform 
as  required  by  its  performance  specification. 

FIXED  COST  -  Those  costs  which  remain  relatively  constant 
irrespective  of  volume. 

FLOW  DIAGRAM  -  The  paths  of  movement  of  workers  and/or  materials 
super*' imposed  on  a  graphical  representation  of  a  work  area. 

FLOW  PROCESS  CHART  -  A  graphic  representation  of  the  sequence  of 
all  operations,  transportations,  inspections,  delays,  and 
storages  occurring  during  a  process  or  procedure. 

FLOW  TIME  -  The  time  required  for  a  defined  amount  of  work  to  be 
completed. 

GANTT  CHART  -  A  graphic  representation  of  a  time  scale  of  the 
current  relationship  between  actual  and  planned  performance. 

GENERAL  AND  ADMINISTRATIVE  COSTS  (G&A)  -  An  overhead  cost  cate¬ 
gory  for  accumulation  of  such  costs  as  personnel  department, 
accounting,  purchasing,  etc. 

GOVERNMENT  ACQUISITION  QUALITY  ASSURANCE  -  The  function  by  which 
the  government  determines  whether  a  contractor  has  fulfilled  his 
contract  obligations  pertaining  to  quality  and  quantity. 

IDLE  TIME  -  A  time  interval  during  which  either  the  workman,  the 
equipment,  or  both  do  hot  perform  useful  work. 

IN  PROCESS  INVENTORY  CONTROL  -  The  process  whereby  materials  and 
parts  are  effectively  and  efficiently  planned  and  controlled  to 
assure  their  availability  at  the  required  stage  or  production. 

INDEPENDENT  COST  ANALYSIS  (ICA)  -  An  analysis  of  program  cost 
estimates  conducted  by  an  impartial  body  disassociated  from  the 
management  of  the  program. 

INDEPENDENT  COST  ESTIMATE  (ICE)  -  The  government's  cost  estimate 
used  for  program  approvals,  for  establishing  budget  estimates  and 
as  a  baseline  for  evaluating  offerors  proposals.  The  ICE  should 
be  an  independent,  objective  unbiased  estimate  which  stands  on 
its  own  as  a  "yardstick"  for  evaluating  offerors  proposals. 

INDIRECT  COST  -  Costs  necessary  in  manufacturing  which  cannot  be 
readily  identified  with  or  changed  to  a  particular  part,  product, 
or  group  of  parts  or  products. 

INDIRECT  LABOR  -  Work  which  is  performed  rendering  services 
necessary  to  production,  the  cost  of  which  cannot  be  assessed 
against  any  part,  product,  or  group  of  parts  or  products 
accurately  or  without  undue  effort  and  expense. 


INDIRECT  MATERIAL  -  Material  consumed  in  the  process  of  produc¬ 
tion  or  manufacture  that  does  not  become  a  part  of  the  finished 
product  and/or  cannot  be  readily  identified  with  or  changed  to  a 
particular  part,  product,  or  group  of  parts  or  products. 

INDIVIDUAL  ACCEPTANCE  TEST  -  This  is  based  on  a  test  of  predeter¬ 
mined  critical  items  to  verify  their  operational  characteristics 
prior  to  assembly  into  subsystems.  Waivers  to  this  requirement 
such  as  using  the  end  item  acceptance  tests  is  not  recommended  as 
production  expediency.  This  test  should  be  capable  of  being 
performed  on  the  same  fixtures  used  for  preceding  type  tests. 

INDUSTRIAL  ENGINEERING  -  The  art  and  science  of  utilizing  and 
coordinating  workers,  equipment,  and  materials  to  attain  a 
desired  quantity  of  output  at  a  specified  time  and  at  an  optimum 
cost.  This  may  include  gathering,  analyzing,  and  acting  upon 
facts  pertaining  to  building  and  facilities,  layouts,  personnel 
organization,  operating  procedures,  methods,  processes, 
schedules,  time  standards,  wage  rates,  wage  payment  plans,  costs, 
and  systems  for  controlling  the  quality  of  goods  and  services. 

INHEI^NT  R  &  M  VALUE  -  Any  measure  of  reliability  or  maintain¬ 
ability  that  includes  only  the  effects  of  item  design  and 
installation,  and  assumes  an  ideal  operating  and  support  environ¬ 
ment. 

INSPECTION  -  The  examination  and  testing  of  supplies  and  services 
(including,  when  appropriate,  raw  materials,  components,  and 
intermediate  assemblies)  to  determine  whether  they  conform  to 
specified  requirements. 

JOB  ORDER  COST  SYSTEM  -  Direct  and  overhead  cost  data  are  accumu¬ 
lated  by  each  contract  or  order. 

LABOR  PRODUCTIVITY  -  The  rate  of  output  of  a  worJcman  or  group  of 
workers  per  unit  of  time,  usually  compared  to  an  established 
standard  or  expected  rate  of  output. 

LABOR  STANDARDS  -  A  compilation  by  time  study  of  standard  time 
for  each  element  of  a  given  type  of  work.  Once  eleme.nt  sta.ndards 
have  been  established,  the  standards  are  applied  to  work  contain¬ 
ing  similar  elements  without  making  actual  time  studies  of  the 
work. 

LIFE  CYCLE  COST  -  The  Life  Cycle  Cost  (LCC)  of  a  system  is  the 
total  cost  to  the  government  of  acquisition  and  ownership  of  that 
system  over  its  full  life.  It  includes  the  cost  of  development, 
acquisition,  support  and,  where  applicable,  disposal. 

LINE  OF  BALANCE  -  A  graphic  display  of  scheduled  units  versus 
actual  units  over  a  given  set  of  critical  sc.hedula  control  poinrs 
on  a  particular  day. 

MAINTAINABILITY  -  The  ability  of  an  item  to  be  rerair.ed  in  or 


restored  to  specified  condition  when  maintenance  is  performed  by 
personnel  having  specified  skill  levels,  using  prescribed  pro¬ 
cedures  and  resources,  at  each  prescribed  level  of  maintenance 
and  repair. 

MANPOWER  SCHEDULING  AND  LOADING  -  The  effective  and  efficient 
utilization  and  scheduling  of  available  manpower  according  to 
their  skills  to  ensure  that  required  manufacturing  operations  are 
properly  coordinated  and  executed. 

MANTECH  (MANUFACTURING  TECHNOLOGY)  -  Manufacturing  Technology 
refers  to  any  action  which  has  its  objective,  1)  the  timely 
establishment  or  improvement  of  the  manufacturing  processes, 
techniques,  or  equipment  required  to  support  current  and 
projected  programs,  and  2)  the  assurance  of  the  ability  to 
produce,  reduce  lead  time,  ensure  economic  availability  of  end 
items,  reduce  costs,  increase  efficiency,  improve  reliability,  or 
to  enhance  safety  and  anti-pollution  measures. 

MANUFACTURING,  OVERHEAD  -  A  form  of  indirect  costs  -  accumulated 
manufacturing  costs  prorated  over  all  products  in  process, 
generally  as  a  percent  of  direct  labor  and/or  material. 

MATERIAL  -  Property  which  may  be  incorporated  into  or  attached  to 
an  end  item  to  be  delivered  under  a  contract  or  which  may  be 
consiamed  or  expended  in  the  performance  of  a  contract.  It 
includes,  but  is  not  limited  to,  raw  and  processed  material, 
parts,  components,  assemblies,  fuels  and  lubricants  and  small 
tool  and  supplies  which  may  be  consumed  in  normal  use  in  the 
performance  of  a  contract. 

METHODS  ENGINEERING  -  The  technique  that  subjects  each  operation 
of  a  given  piece  of  work  to  close  analysis  in  order  to  eliminate 
every  unnecessary  element  or  operation  and  in  order  to  approach 
the  quickest  and  best  method  of  performing  each  necessary  element 
or  operation.  It  includes  the  improvement  and  standardization  of 
methods,  e^ipment,  and  working  conditions;  operator  training; 
the  determination  of  standard  times;  and  occasionally  devising 
and  administering  various  incentive  plans. 

METHODS  STUDY  -  Systematic  recording  of  all  activities  performed 
in  a  job  or  position  of  work  including  standard  times  for  the 
work  performed.  Work  simplification  notes  are  written  during  the 
study . 

METROLOGY  -  The  science  of  weights  and  measures  used  to  determine 
conformance  to  technical  requirements  including  the  development 
of  standards  and  systems  for  absolute  and  relative  measurements. 

NONRECURRING  -  A  descriptive  term  applied  to  a  type  of  work, 
operation,  part,  or  the  like  that  does  not  recur  frequently  or  in 
any  reasonable  regular  sequence  (also  nonrepetitive) . 

OPERATION  PROCESS  CHART  -  Identifies  the  successive  operations, 
in  their  required  sequence,  for  producing  a  product  (component) . 


OPERATIONAL  R  &  M  VALUE  -  Any  measure  of  reliability  or  maintain¬ 
ability  that  includes  the  combined  effects  of  item  design,  qual¬ 
ity,  installation,  environment,  operation,  maintenance,  and 
repair. 

PROCESS  -  1)  A  planned  series  of  actions  of  operations  which 
advances  a  material  or  procedure  from  one  stage  of  completion  to 
another,  and  2)  a  planned  and  controlled  treatment  that  subjects 
materials  to  the  influence  of  one  or  more  types  of  energy  for  the 
time  required  to  bring  about  the  desired  reactions  or  results. 

PROCESS  COST  SYSTEM  -  Total  costs  for  producing  a  type  of  unit. 
The  number  produced  are  determined  for  regular  accounting  periods 
and  an  average  unit.  The  cost  based  on  that  data  is  determined. 

PRODUCIBILITY  -  The  relative  ease  of  producing  an  item  or  system 
which  is  governed  by  the  characteristics  and  features  of  a  design 
that  enable  economical  fabrication,  assembly,  inspection,  and 
testing  using  available  production  technology. 

PRODUCIBILITY  ENGINEERING  AND  PLANNING  (PEP)  -  The  production 
engineering  tasks  and  production  planning  measures  undertaken  to 
ensure  a  timely  and  economic  transition  from  development  to  the 
production  phase  of  a  program. 

PRODUCTION  MANAGEMENT  -  The  effective  use  of  resources  to  produce 
on  schedule  the  required  number  of  end  items  that  meet  specified 
quality,  performance,  and  cost.  Production  management  includes 
but  is  not  limited  to  industrial  resource  analysis,  producibility 
assessment,  producibility  engineering  and  planning,  production 
engineering,  industrial  preparedness  planning,  post-production 
planning,  and  productivity  enhancements. 

PRODUCTION  PLANNING  -  The  systematic  scheduling  of  workers, 
materials,  and  machines  by  using  lead  times,  time  standards, 
delivery  dates,  work  loads,  and  similar  data  for  the  purpose  of 
producing  products  efficiently  and  economically  and  meeting 
desired  delivery  dates. 

PRODUCTION  PLANNING  AND  CONTROL  -  The  planning  of  operations  that 
accomplishes  coordination  of  workers,  material,  and  facilities  to 
achieve  effective  and  efficient  production  goals. 

PRODUCTION  READINESS  REVIEW  (PRR)  -  A  formal  examination  of  a 
program  to  determine  whether  the  design  is  ready  for  production, 
production  engineering  problems  have  been  resolved,  and  the 
producer  has  accomplished  adequate  planning  for  the  production 
phase. 

PRODUCTIVITY  -  The  actual  rate  of  output  or  production  per  unit 
of  time  worked. 

PRODUCTS  -  All  items,  materiel,  material,  data,  software, 
supplies,  systems,  assemblies,  subassemblies ,  or  portions  thereof 


which  are  produced,  purchased,  developed  or  otherwise  used  by 
DoO. 

QUALITY  ASSURANCE  -  A  planned  and  systematic  pattern  of  all 
actions  necessary  to  provide  confidence  that  adequate  technical 
requirements  are  established;  products  and  services  conform  to 
established  technical  requirements;  and  satisfactory  performance 
is  achieved. 

QUALITY  OF  CONFORMANCE  -  The  extent  to  which  the  product  or  sys¬ 
tem  conforms  to  design  criteria  or  requirements. 

QUALITY  OF  DESIGN  -  The  adequacy  of  the  product  or  system  design 
to  meet  the  needs  of  the  user. 

QUALITY  IMPROVEMENT  -  The  emphasis  on  continual •  reduction  of 
quality  costs,  regardless  of  the  starting  point. 

QUALITY  PROGRAM  -  A  program  which  is  developed,  planned,  and 
managed  to  carry  out,  cost-effectively,  all  efforts  to  effect  the 
quality  of  materiel  and  services  from  concept  through  validation, 
full-scale  development,  production,  deployment,  and  disposal. 

R  &  M  ACCOUNTING  -  That  set  of  mathematical  tasks  which  establish 
and  allocate  quantitative  R  &  M  requirements,  and  predict  and 
measure  quantitative  R  &  M  achievements. 

R  &  M  ENGINEERING  -  That  set  of  design,  development,  and  manufac¬ 
turing  tasks  by  which  R  &  M  are  achieved. 

RELIABILITY  -  The  duration  or  probability  of  failure  free  perfor¬ 
mance  under  stated  conditions. 

REALIZATION  FACTOR  -  The  ratio  of  actual  performance  time  to 
standard  performance  time,  usually  expressed  as  a  decimal  number. 

REWORK  -  Any  corrections  of  defective  work  either  before,  during 
or  after  inspection. 

SCRAP  -  Residual  material  resulting  from  machine  or  assembly 
processes,  such  as  machine  shavings,  unusable  lengths  of  wire, 
faulty  parts. 

SET  UP  TIME  -  The  time  required  to  arrange  locating  fixtures  and 
equipment  in  order  to  begin  productive  work;  including  adjust¬ 
ments  and  take  down  of  the  original  set  up. 

SHRINKAGE  -  An  additional  quantity  of  material  added  to  the 
quantity  listed  on  the  Bill  of  Material  to  provide  for  spoilage, 
scrap,  waste  and  natural  attrition  (See;  Attrition) . 

SOURCE  SELECTION  -  The  process  wherein  the  requirements,  facts, 
recommendations  and  government  policy  relevant  to  an  award 
decision  in  a  competitive  procurement  of  a  system/project  are 
examined  and  the  decision  made. 


SPOILAGE  -  A  form  of  waste  material  resulting  from  misuse  or 
material  or  errors  in  workmanship. 

STANDARD  -  A  term  applied,  in  work  measurement,  to  any 
established  or  accepted  rule,  model,  or  criterion  against  which 
comparisons  are  made. 

STANDARD  COST  -  The  normal  expected  cost  of  an  operation,  pro¬ 
cess,  or  product  including  labor,  material,  and  overhead  charges, 
computed  on  the  basis  of  past  performance  costs,  estimates,  or 
work  measurement. 

SYSTEM  EFFECTIVENESS  -  The  measure  of  the  degree  to  which  the 
hardware  and  software  achieve  the  mission  requirements  in  the 
operational  environment  as  evidenced  in  system  availability, 
dependability,  and  capability. 

SYSTEM  R  i  M  PARAMETER  -  A  measure  of  reliability  or  maintain¬ 
ability  in  which  the  units  of  measurement  are  directly  related  to 
operational  readiness,  mission  success,  maintenance  manpower 
cost,  or  logistic  support  cost. 

TECHNOLOGY  MODERNIZATION  -  The  coupling  of  modernization  with  the 
implementation  of  advanced  manufacturing  technology  by  providing 
incentives  for  contractor  (and  subcontractor)  capitalization. 

TESTING  -  An  element  of  inspection.  Generally  denotes  the  deter¬ 
mination  by  technical  means  of  the  properties  or  elements  of 
supplies,  or  components  thereof,  including  functional  operation, 
and  involves  the  application  of  established  scientific  principles 
and  procedures. 

TOUCH  LABOR  -  Defined  as  production  labor  which  can  be  reasonably 
and  consistently  related  directly  to  a  unit  of  work  being  manu¬ 
factured,  processed,  or  tested.  It  involves  work  affecting  the 
composition,  condition,  or  production  of  a  product;  it  may  also 
be  referred  to  as  hands  on  labor  or  factory  labor.  It  includes 
such  functions  as  machining,  welding,  fabricating,  painting, 
assembling,  and  functional  testing  of  production  articles. 

VARIABLE  EXPENSE  -  Expenditures  that  vary  in  proportion  to  the 
volume  of  production,  such  that  an  increase/decrease  in  produc¬ 
tion  causes  an  increase/decrease  in  the  variable  cost. 

VARIANCE  -  The  difference  between  any  standard  or  expected  value 
and  an  actual  value.  For  example,  the  difference  between  the 
established  standard  cost  and  the  cost  actually  incurred  i.n  per¬ 
forming  a  job  or  operation. 

WORK  SAMPLING  STUDY  -  A  statistical  sampling  technique  employed 
to  determine  the  proportion  of  delays  or  ooher  classifications  of 
activity  present  in  the  total  work  cycle. 
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APPENDIX  A 

EXAMPLES  OF  TYPICAL  COSTS  OF  QUALITY 


Prevention: 

CXiatity  engineering 
Quality  circles 
Quality  training 

Supervision  of  prevention  activities 
Pilot  studies 
Systems  development 
Process  controls 

Technical  support  provided  to  verujors 

Analysis  of  in-house  processes  for  the  purpose  of  improving  quality 
Auditing  the  effectiveness  of  the  quality  system 

Appraisal: 

Supplies  used  in  test  and  inspection 
Test  and  inspection  of  incoming  materials 
Component  inspection  and  testing 
Review  of  sales  orders  for  accuracy 
In-process  inspection 
Final  product  inspection  and  testing 

Field  inspection  at  customer  site  prior  to  final  release  of  product 
Reliability  testing 

Supervision  of  appraisal  activities 
Plant  utilities  in  inspection  area 
Depreciation  of  test  equipment 
Internal  audits  of  inventory 

Internal  Failure:  ~ 

Net  cost  of  scrap 

Net  cost  of  spoilage 

Disposal  of  defective  product 

Rework  tabor  and  overhead 

Reinspection  of  reworked  product 

Retest  of  reworked  product 

Downtime  due  to  quality  problems 

Net  opportunity  cost  of  products  classified  as  seconds 

Data  re-entered  due  to  keypunch  errors 

Defect  cause  analysis  and  investigation 

Revision  of  in-house  computer  programs  due  to  software  errors 

Adjusting  entries  necessitated  by  quality  problems 

External  Failure: 

Cost  of  responding  to  customer  complaints 
Investigation  of  customer  ciaifns  on  warranty 
Warranty  repairs  and  replacements 
Out-of-warranty  repairs  and  replacements 
Product  recalls 
Product  liability 

Returns  and  allowances  because  of  quality  problems 
Opportunity  cost  of  lost  sales  because  of  bad  quality  reputation 


A.  APPRAISAL  COSTS 


1.  Production  equipment  qualification  and  recertification 

2.  Evaluation  and  audit  of  entire  quality  assurance  program 

3.  Quality  inference  data  analysis 

4 .  Process  control  data  analysis 

5.  Final  test  at  customer's  site;  can  be  divided  or  categorized 
as  salaries,  equipment  not  capitalized,  rental  charges  for 
equipment,  supplies,  travel  expense,  and  subsistence 

6.  Final  test  in  plant  by  sampling  techniques;  can  be  divided 
or  categorized  as  wages,  equipment  not  capitalized,  rental 
of  ec[uipment,  and  supplies 

7.  Final  inspection  in  plant  by  sampling  techniques;  can  be 
divided  or  categorized  as  wages,  equipment  not  capitalized, 
rental  of  equipment,  and  supplies 

8.  Portion  of  100%  final  test  chargeable  to  quality  inference 

9.  Portion  of  100%-  final  inspection  chargeable  to  quality 
inference 

10.  Outside  laboratories  charges  for  tests  on  finished  goods 

11.  Portion  of  100%  laboratory  final  test  chargeable  to  quality 
inference 

12.  Inspection  and  release  of  finished  prototypes  or  first 
finished  units 

13.  Test  of  finished  prototypes  or  first  finished  units 

14.  Incoming  test  by  sampling  techniques;  can  be  divided  or 
categorized  into  wages,  equipment  not  capitalized,  rental  of 
equipment,  and  supplies 

15.  Incoming  inspection  by  sampling  techniques;  can  be  divided 
or  categorized . into  wages,  equipment  not  capitalized,  rental 
of  equipment  and  supplies 

16.  Portion  of  100%  incoming  inspection  chargeable  to  quality 
inference 

17.  Portion  of  100%  incoming  test  chargeable  to  quality 
inference 


18.  Outside  laboratories  charges  for  tests  on  incoming  material 

19.  Vendors  charges  for  tests  on  incoming  material 

20.  Laboratory  test  of  incoming  materials  by  sampling 
techniques;  can  be  divided  or  categorized  into  wages, 
equipment  not  capitalized  rental  of  equipment,  and  supplies 

21.  Portion  of  100%  laboratory  test  of  incoming  materials 
chargeable  to  quality  inference 

22.  First  piece  inspection;  can  be  divided  or  categorized  into 
wages,  equipment  not  capitalized  rental  for  equipment,  and 
supplies 

23.  First  piece  test;  can  be  divided  or  categorized  into  wages, 
equipment  not  capitalized,  rental  for  equipment,  and 
supplies 

24.  In-process  inspection  by  sampling  procedures;  can  be  divided 
or  categorized  into  wages,  equipment  not  capitalized,  rental 
for  equipment,  and  supplies 

25.  In-process  test  by  sampling  procedures;  can  be  divided  or 
categorized  into  wages,  equipment,  and  supplies 

26.  Portion  of  100%  in-process  inspection  chargeable  to  quality 
inference 

28.  Portion  of  100%  laboratory  in-process  test  chargeable  to 
quality  inference 

29.  Outside  laboratories  charges  for  tests  on  in-process 
material 

30.  Process  control  tests;  can  be  broken  into  wages,  equipment 
not  capitalized,  rental  for  equipment,  and  supplies 

31.  Cost  of  product  destroyed  in  testing;  can  be  divided  into 
incoming,  in-process,  first  piece,  and  process  control 

32.  Auditing  systems  and  procedures 

33.  Auditing  product  quality 

34.  Auditing  process  control  and  process  control  tests 
Audit  of  product  packing 


35. 


36.  Audit  activities  to  evaluate  end  product  quality  and 
reliability;  including  auditing  systems,  procedures, 
calculations  and  performance 

37.  Surveillance  of  special  operations  and  processes 

38.  Vendor  quality  surveillance 

39.  Inspection  supplies 

40.  Test  supplies 

41.  Tests  for  evaluating  end  product  quality  and  reliability, 
includes  life,  environment  and  reliability  tests 

42.  Set-up  for  test 

43.  Set-up  for  inspection 

44.  Test  of  product  packing 

45.  Inspection  of  product  packing 

46.  Quality  checking  operations  by  production  employees 

47.  Inspection  and  test  activity  to  review  templates  and  tools 

48.  Reinspection  of  jigs  and  fixtures 

49.  Regualif ication  tests  of  tools  and  processes 

50.  Inspection  and  test  activity  to  give  data  on  effectiveness 
of  corrective  actions 

51.  Reports  of  inspections 

52.  Reports  of  tests 

53.  Data  processing,  filing,  and  summarizing 


B.  INTERNAL  FAILURE 


1.  Failure  analysis  including  cause  of  scrap  and  cause  of 
rework;  can  be  further  divided  or  categorized  as  wages, 
rental  of  equipment,  equipment  not  capitalized,  supplies, 
and  vendor  contacts 

2.  Failure  analysis  of  purchased  parts  including  investigation 
of  cause  of  scrap  and  cause  of  rework;  can  be  segregated 
into  wages,  equipment  not  capitalized,  rental  charges  for 
equipment,  supplies,  travel  costs,  and  vendor  contacts 

3.  Failure  analysis  consisting  of  special  tests  and  inspections 

4.  Portion  of  100%  final  test  due  to  need  to  eliminate  defec¬ 
tive  product 

5.  Portions  of  100%  final  inspection  due  to  need  to  eliminate 
defective  product 

6.  Portion  of  100%  laboratory  final  test  chargeable  to  need  to 
eliminate  defective  product 

7.  Portion  of  100%  incoming  test  chargeable  to  need  to  elimi¬ 
nate  defective  product 

8.  Portion  of  100%  incoming  inspection  chargeable  to  need  to 
eliminate  defective  product 

9.  Portion  of  100%  laboratory  test  of  incoming  materials 
chargeable  to  need  to  eliminate  defective  product 

10.  Portion  of  100%  in-process  test  chargeable  to  need  to  elimi¬ 
nate  defective  product 

11.  Portion  of  100%  in-process  inspection  chargeable  to  need  to 
eliminate  defective  product 

12.  Portion  of  100%  laboratory  in-process  test  chargeable  to 
need  to  eliminate  defective  product 

13.  Material  Review  Board  activities  either  formal  or  informal; 
may  be  subdivided  into  disposition  is  scrap,  disposition  is 
rework,  disposition  is  downgraded  material 

14.  Rework  (includes  failure  correction  in  defective  product); 
may  be  divided  into  (a)  produced  internally  and  (b)  purchase 
material;  (a)  may  be  then  divided  into  inspection  and  test 
error  or  production  error;  (b)  may  be  divided  into  ordered 
incorrectly  or  defective 


15.  Evaluation  of  reworked  material  inspection  and  test  data 

16.  Inspection  of  reworked  material 

17.  Test  of  reworked  material 

18.  Rework  fault  of  vendor 

19.  Scrap;  production  error;  may  be  divided  into  produced 
internally  or  purchased  material- 

20.  Scrap;  test  or  inspection  error;  may  be  divided  into  pro¬ 
duced  internally  or  purchased  material 

21.  Scrap;  material  in  stock  or  received  before  effective  can¬ 
cellation  which  failure  analysis  shows  to  be  inadequate 

22.  Charges  for  canceling  orders  when  defect  analysis  shows 
material  to  be  inadequate 

23.  Scrap;  fault  of  vendor 

24.  Downgrading;  loss  in  value  of  product  due  to  not  meeting 
planned  requirements  but  still  has  more  than  salvage  value 

25.  Downtime;  loss  in  production  time  due  to  failure  analysis  or 
defective  product 

26.  Reinspection  due  to  product  defects  (not  after  rework) 

27.  Re-test  due  to  product  defects  (not  after  rework) 

28.  Extra  production  operations  added  because  of  presence  of 
defectives 

29.  Extra  inspections  due  to  product  defects  (not  100% 
screening) 

30.  Extra  tests  due  to  product  defects  (not  100%  screening) 

31.  Incidental  costs  of  scrap 

32.  Incidental  costs  of  rework 

33.  Replacement  of  lost  material 

34.  Replacement  of  material  damaged  between  departments 

35.  Rejection  report  writing  and  processing 


36.  Extra  record  keeping  due  to  defective  products 


37.  Burden  arising  from  excess  production  capacity  necessitated 
by  defectives  38.  Vendor  charges  for  corrective  engineering 
for  process 

39.  Corrective  engineering  for  processes  -  not  analysis 

40.  Retooling  because  of  corrective  engineering 

41.  Rework  of  patterns,  molds,  or  jigs  due  to  low  quality 

42.  Redesign  of  patterns,  molds,  or  jigs  due  to  low  quality 

43.  Refabrication  of  patterns,  molds,  or  jigs  due  to  low  quality 


44. 


Defect  inference  data  analysis 
ysis) 


(failure  analysis  data  anal- 
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C.  EXTERNAL  FAILURE 


1.  Field  failure  analysis  for  purpose  of  taking  corrective 
action  for  future  production 

2.  Field  complaint  investigation  for  purposes  of  taking  volun¬ 
tary  corrective  action  on  equipment  now  in  customers'  use; 
may  be  divided  into  wages,  travel  expense,  subsistence, 
equipment,  and  supplies 

3 .  Field  complaint  investigation  for  purpose  of  in-guarantee 
corrections;  may  be  divided  into  travel,  subsistence,  wages, 
equipment,  and  supplies 

4.  Field  complaint  negotiations  with  customers 

5.  Field  repair  performed  voluntarily  to  prevent  future  cus¬ 
tomer  complaints 

6.  Field  service  performed  voluntarily  to  prevent  future  cus¬ 
tomer  complaints 

7.  Engineering  for  in-plant  correction  of  field  complaint 
because  of  expressed  or  implied  guarantees 

8.  Engineering  for  field  correction  of  field  complaint  because 
of  expressed  or  implied  guarantees 

9.  Repairs  for  in-plant  correction  of  field  complaint  because 
of  expressed  or  implied  guarantees 

10.  Repairs  for  field  correction  of  field  complaint  because  of 
expressed  or  implied  guarantees 

11.  Production  for  in-plant  correction  of  field  complaint 
because  of  expressed  or  implied  guarantees 

12.  Production  for  field  correction  of  field  complaint  because 
of  expressed  or  implied  guarantees 

13.  Service  for  in-plant  correction  of  field  complaint  because 
of  expressed  or  implied  guarantees 

14.  Service  for  field  correction  of  field  complaint  because  of 
expressed  or  implied  guarantees 

15.  Billing  adjustment  or  allowance  because  of  expressed  or 
implied  guarantees 


16.  Loss  of  quality  or  reliability  incentive  fees 

17.  Loss  of  customer  good  will 

18.  Business  policy  concessions  to  customer  (not  part  of  quality 
related  costs)  19.  Vendor  charges  for  corrective  engineering 
for  product 

20.  Corrective  engineering  for  product  -  not  failure  analysis 
(possibility  caused  by  quality  or  reliability  failure  anal¬ 
ysis) 

21.  Vendor  charges  for  failure  analysis 


D.  PREVENTION 


1.  Vendor  charges  for  quality  engineering  in  process  planning 

2.  Vendor  charges  for  quality  engineering  in  product  design 

3.  Quality  engineering  in  designs  for  product  including  exam¬ 
inations  of  tolerances. 

4.  Quality  engineering  in  new  designs  of  processes 

5.  Planning  control  of  vendor  audits,  surveillance  and  surveys 

6.  Travel  costs  for  other  quality  purposed  (not  failure  anal¬ 
ysis) 

7.  Vendor  contacts  for  quality  purposes  not  failure  analysis 
efforts 

8.  Verification  and  review  of  information  supplied  to  vendor 

9.  Travel  costs  for  vendor  rating 

10.  Vendor  contracts  for  vendor  rating 

11.  Vendor  rating;  analysis  of  performance  records 

12.  Vendor  rating;  keeping  performance  records 

13.  Vendor  rating;  evaluating  quality  capabilities 

14.  Vendor  rating;  evaluating  reliability  capabilities 

15.  Planning  incoming  test 

16.  Planning  incoming  inspection 

17 .  Formulation  and  issuance  of  test  procedures 

18.  Formulation  and  issuance  of  inspection  procedures 

19.  Implementing  test  and  inspection  procedures 

20.  Purchase  of  test  or  material  for  devices  (not  capitalized) 
including  procurement  planning 

21.  Purchase  of  inspection  devices  or  material  for  devices  (not 
capitalized)  including  procurement  planning 

22.  Construction  of  test  devices  (not  capitalized) 


23.  Construction  of  inspection  devices  (not  capitalized) 

24.  Design  and  development  of  test  devices  (not  capitalized) 

25.  Design  of  inspection  devices  (not  capitalized) 

26.  Design  of  measurement  devices  (not  capitalized) 

27.  Design  and  development  of  control  devices  (not  capitalized) 

28.  Rental  or  use  charges  for  others'  inspection  equipment 

29.  Rental  or  use  charges  for  others'  test  equipment 

30.  Depreciation  write-off  for  capitalized  inspection  and  test 
equipment  (may  be  different  from  tax  write  off) 

31.  Formulation,  issuance,  and  implementation  of  process  con¬ 
trols 

32.  Development  of  process  controls 

33.  Review  of  product  packing 

34.  Training  and  education  of  inspection  employees  for  quality 

35.  Training  and  education  of  test  employees  for  quality 

36.  Training  and  education  of  special  process  evaluation  employ¬ 

ees  for  quality 

37.  Planning  quality  training  and  education 

38.  Conducting  quality  training  and  education 

39.  Employee  certification  and  training  for  training  for  certi¬ 
fication  and  recertification  (does  not  include  instruction 
for  achievement  of  normal  proficiency) 

40.  Training  and  education  of  production  employees  for  quality 

41.  Reliability  engineering  benefiting  quality 

42.  Other  reliability  activities  benefiting  quality 

43.  Quality  review  of  tool  design 

44.  Tool  use  coordination 

Customer  contacts  for  quality  purposes  not  failure  analysis 
efforts 


45. 


46.  Evaluation  of  customer  quality  requirements  and  existing 
plant  capabilities 

47.  Formulation,  issuance,  and  implementation  of  quality  plans 

48.  Formulation  and  interpretation  of  quality  standards 

49.  Formulation  and  coordination  of  specifications 

50.  Prescribing  and  recording  policies  and  procedures  for  qual¬ 
ity  assurance 

51.  Planning  and  performing  process  capability  experiments 

52.  Analysis  of  pre-production  run  data 

53.  Analysis  of  quality  inference  data  prior  to  product  shipment 

54.  Evaluation  and  analysis  of  entire  quality  cost  data 

55.  Maintenance  of  test  equipment 

56.  Maintenance  of  inspection  equipment 

57.  Calibration  of  test  equipment 

58.  Calibration  of  inspection  equipment 

59.  Calibration  of  production  equipment 

60.  Maintaining  primary  standards 

61.  Calibration  laboratory  for  gauges  and  measuring  devices 

62.  Vendor  audit 


E.  GENERAL  COSTS 


1.  Planning  quality  cost  analysis  system 

2.  Administration  costs;  includes  elements  not  logically  a  part 
of  quality  creation,  equality  inference,  or  defect  inference 

3.  Accounting  and  data  processing  cost  incurred  in  accumula¬ 
ting,  analyzing  and  reporting  quality  and  reliability  data 

4.  Handling  and  records  control  of  equipment  in  storage  or  in 
transport  to  calibration  laboratory 

5.  cost  of  power  consumed  in  test,  inspection,  or  quality 
assurance  department 

6.  Value  of  floor  space  used  primarily  for  inspection  or  test 

7.  Equipment  depreciation;  remaining  book  value  at  time  of 
replacement  of  capitalized  equipment 

8.  Approval  by  outside  agencies  such  as  Underwriters  Laboratory 
fees,  product  endorsement  fees,  insurance  underwriters,  and 
outside  test  labs 

9.  Control  of  stores  tools 

10.  Periodic  inspection  of  stored  tools 

11.  Quality  and  reliability  studies  for  bid  proposals 


INDUSTRY  SURVEY  QUESTIONNAIRE 


(CONDUCTED  VIA  TELEPHONE) 

Are  you  using  any  measures  of  cost  of  quality  as  a 
management  tool  at  this  time? 

Yes  _  or  No  _ 

If  yes,  at  what  level?  (who  looks  at/uses  the  data?) 


If  not,  why  not?  Have  you  considered  it,  and  then  rejected 
it? 


What  are  the  measures  you  are  looking  at? 


How  is  the  data  expressed? 


How  is  the  data  captured? 

Through  standard  accounting  system? 
Special  system 

Any  changes  made  to  accounting  system? 
What? 


What  are  you  doing  as  a  result  of  having  the  data? 

Goals  to  reduce?  _ 

Identifying  problem  areas?  _ 


t-That  are  you  using  to  gage  the  meaning  of  your  COQ 
measurement?  (Standard  for  measurement) 


9.  How  long  have  you  been  measuring  COQ  and  using  it  as  a 
management  tool? 


10.  What  caused  you  to  start  looking  at  COQ? 

Government  _ 

Other 


11.  Based  on  your  experience  up  to  now,  do  you  believe  use  of 
COQ  will  continue? 


12.  In  order  to  make  the  handbook  of  maximum  benefit  to 

government  and  the  contractor,  what  one  thing  would  you 
recommend  we  include  when  developing  the  book? 
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Generally  speaking,  those  companies  surveyed  indicated  that  they 
were  using  cost  of  quality  as  a  management  tool.  Four  chose  not 
to  respond  to  our  survey  when  called.  Of  the  two  companies  not 
using  it,  reasons  given  were: 

-  Three  chose  not  to  respond  to  our  survey  when  called. 

One  had  just  recently  established  a  quality  department. 

One  had  tried  it  and  had  not  found  it  to  be  useful. 


Of  those  companies  using  cost  of  quality,  73%  indicated  that 
their  primary  focus  is  on  internal  failure  costs,  while  38%  said 
that  they  also  looked  at  appraisal  and  prevention  costs.  How¬ 
ever,  of  that  38%  (24  companies)  ,  only  two  were  looking  beyond 
the  quality  department  for  any  costs,  in  this  case  at  the  engi¬ 
neering  function.  Two  of  the  twenty  four  were  following  the 
general  guidelines  developed  by  the  Aerospace  Industrial  Associ¬ 
ation  and  the  America  Society  for  Quality  Control. 

As  for  who  looks  at  the  data,  83%  or  52  companies  indicated  that 
top  and  middle  level  managers  reviewed  the  data  in  some  form,  but 
only  40%  said  that  the  data  was  used  at  the  first  line  supervi¬ 
sion  level  as  an  aid  to  getting  at  problems. 

The  survey  revealed  that  68%  of  the  companies  expressed  the  data 
in  terms  of  some  dollar  amount.  Thirty  percent  looked  at  the 
data  as  a  percentage  of  sales,  while  49%  looked  at  the  data  as  a 
percent  of  direct  labor.  Seven  companies  looked  at  the  data  in 
terms  of  actual  direct  hours  expended,  and  one  in  terms  of  per¬ 
centage  of  material. 

In  68%  of  the  companies,  cost  of  quality  data  used  was  captured 
through  the  normal  accounting  system.  Use  of  a  system  above  and 
beyond  the  normal  accounting  system  occurred  in  49%  of  the  com¬ 
panies  (so  in  49%  both  the  normal  and  an  additional  system  is 
used) .  Usually  the  additional  system  consisted  of  personal  com¬ 
puters  located  in  the  quality  department. 

As  for  what  use  is  made  of  the  data,  4  0%  said  they  had  estab¬ 
lished  goals  for  reduction.  However,  many  felt  goals  were  not  a 
good  idea,  and  the  survey  found  that  51%  were  using  trend  analy¬ 
sis  rather  than  goals.  Fully  23%  were  also  using  Pareto  analysis 
as  a  technique  for  making  meaningful  use  of  the  data.  Only  17% 
said  that  they  specifically  used  the  available  cost  of  quality 
data  as  a  tool  for  their  corrective  action  board  process  (the 
survey  did  not  determine  what  percent  of  the  contractors  surveyed 
had  MIL-STD-1520  as  a  contractual  requirement) . 


In  terms  of  how  long  the  companies  had  been  using  cost  of  quality 
as  a  management  tool,  the  survey  revealed: 

1  year  15% 

1-3  years  20% 

3-10  years  38% 

10  years  +  27% 


When  asked  what  caused  them  to  embrace  cost  of  quality  as  a  man¬ 
agement  tool,  74%  said  it  was  the  government  requirement,  while 
57%  said  it  was  a  combination  of  both  government  and  recognition 
of  the  good  business  sense  to  do  it.  Fully  100%  said  they  will 
continue  to  use  cost  of  quality  as  a  management  tool. 

Company  representatives  were  also  asked  to  express  their  opinion 
regarding  what  the  handbook  should  contain  in  terms  of  guidance, 
cautions,  etc.  The  list  below  reflects  their  input.  Note:  It 
is  divided  or  categorized  by  the  "top  ten”  responses,  followed  by 
all  other  input.  The  number  in  parenthesis  indicates  the  fre¬ 
quency  of  that  response. 


INDUSTRY  COMMENTS  ON  WHAT  TO 
INCLUDE  IN  HANDBOOK 


TOP  TEN 


Allow  for  implementation  leeway  -  unique  by  company 
(17) 

Tie  in  with  9858  and  1520.  (10) 

Does  contractor  have  a  system  and  is  he  pursuing 
improvement .  ( 9 ) 

Do  not  attempt  to  compare  companies  or  industries.  (9) 
Define  cost  of  quality.  (9) 

Explain  how  to  use  the  data,  especially  MRB  and  CAB. 
(5) 

Use  trend  analysis,  long  term,  not  short  term.  (4) 
Manage  the  basic  information.  (4) 

Stress  multi-disciplined  approach  early  on.  (4) 

Do  not  pressure  into  producing  bad  data.  (4) 


hLL  QT^gB  BESPQ?JS.ES 


Quality  not  measured  by  SSR  only.  (3) 

Be  cautious  of  overhead  affects  on  data.  (3) 

Put  audit  requirements  on  contract.  (3) 

Define  prevention  costs  better.  (3) 

When  COQ  should  be  applied  by  the  government.  (3) 
Normalize  data  and  do  not  expose  the  contractor.  (3) 

Use  goal  setting  so  contractor  knows  how  he  doing.  (3) 
Appreciate  product  mix  and  quality  system  differences. 
(2) 

Use  phased  in  approach,  like  on  1567. 

Top  level  in  government  sees  need  for  defect  reporting 
supported  by  COQ;  lower  level  fragmented  at  system 
level,  no  emphasis  on  effectiveness. 

Use  transition  process  to  get  better  quality. 

Recognize  that  looking  at  percent  reduction  is  wrong. 

Be  positive. 

Engineering  effort  is  often  intangible. 

Hard  to  find  engineering  measure  you  can  track 
statistically . 

Measure  down  to  low  enough  level  to  be  useful. 

A  good  measurement  base  is  needed. 

Better  definition  of  government  upper  and  lower  limits. 
Back  off  on  getting  vendor  costs. 

Emphasize  prevention. 


Prevention  costs  not  worth  the  effort. 

Handbook  50  not  contractual,  but  used  to  evaluate. 
Train  government  and  industry  on  what  is  desired  in 
Cost  of  Quality 

Get  company  officials  to  buy  into  Cost  of  Quality. 
Vendor  Cost  of  Quality  very  important  and  has  big 
savings  potential. 


results  of  on-site  interviews 
CONTRACTOR  VISITS 

In  addition  to  the  63  contractors  interviewed  over  the  telephone, 
on-site  visits  were  made  to  two  contractors,  one  Defense  Contract 
Administration  Services  (DCAS)  Regional  Headquarters,  and  one 
recognized  cost  of  quality  expert  in  the  world  of  academia. 

Both  of  the  contractors  visited  were  under  DCAS  surveillance. 
They  confirmed  that  during  their  recent  cost  of  quality  audits 
conducted  by  DCAS,  the  focus  was  on  FAILURE  costs  only.  (See 
comments  in  Chapter  2,  pages  2-8  to  2-12).  Although  DCAS  has 
expanded  on  what  the  people  in  the  field  should  understand  and 
look  for  in  the  cost  of  quality  area  in  DLAM  8200.2,  the  contrac¬ 
tors  that  were  visited,  as  well  as  several  of  those  contacted  by 
telephone,  made  the  point  that  the  DCAS  manual  is  not  a  contrac¬ 
tual  requirement,  and  they  were  not  doing  anything  in  terms  of 
trying  to  comply  with  that  manual .  Both  contractors  also  expres¬ 
sed  concern  over  the  fact  in  dealing  with  the  government,  they 
feel  everyone  wants  something  different.  DCAS  wants  one  thing, 
DCAA  another,  the  Air  Force  yet  another,  and  so  on.  In  terms  of 
what  should  be  included  in  the  hanoook,  the  responses  given  by 
the  contractors  visited  have  been  included  in  the  lists  of  the 
industry  "top  10”  and  "All  Others",  given  above. 


In  our  discussion  with  DCAS  personnel,  we  found  a  great  deal  of 
consistency  between  what  they  saw  as  problems  in  dealing  with 
cost  of  quality  and  what  the  contractors  said  (telephone  and 


those  visited) .  For  example,  the  emphasis  must  be  on  the  use  of 
cost  of  (juality  data,  not  on  just  having  it  available.  Flexibil¬ 
ity  is  needed  to  accomnodate  different  product  lines,  different 
program  phases,  and  different  business  management  and  financial 
accounting  approaches.  One  point  made  was  that  it  is  difficult 
to  ascertain  at  this  stage  what,  if  any,  benefits  are  being  real¬ 
ized  through  the  contractors'  corrective  action  board  process  by 
having/using  cost  of  quality  information.  One  opinion  expressed 
was  that  doing  a  good  cost  of  quality  effort  can  be  used  effec¬ 
tively  when  tying  in  other  government  initiatives,  such  as  Air 
Force  GET  SPEC,  and  emphasis  on  prime  contractor  of 
subcontractors . 


GOVERNMENT  DISCUSSIONS 

In  terms  of  what  DCAS  personnel  recommended  be  included  or 
covered  in  the  handbook,  these  are  the  major  items  discussed. 

Standard  base  for  expressing  cost  of  quality  would  be 
beneficial. 

Documentation  of  contractor  action  taken  as  a  result  of 
reacting  to  cost  of  quality  is  lacking  and  is  needed. 
Overhead  rates  vary  too  much,  not  true  reflections  of 
cost  of  quality  burden.  Should  use  FPRA  rates,  clearly 
defined.  Need  to  standardize. 

Data  must  be  traceable  down  to  the  nonconforming  item. 
What  corrective  action  should  be  included  in  cost  of 
quality  should  be  spelled  out. 

Warranty  costs  must  be  clearly  defined. 

-  Importance  of  "start  up  scrap",  planned  scrap 


versus  actual  spoilage  should  be  considered. 

Once  elements  are  identified,  data  must  be  collected. 
Set  no  dollar  threshold  on  what  is  good  or  bad  for  cost 
of  quality. 

Clearly  express  the  purpose  of  why  government  is  look¬ 
ing  at  Cost  of  Quality  and  wants  contractors  to  look  at 
it. 

Allow  contractor  to  use  estimates,  as  long  as  he  can 
justify  the  estimate. 

Must  protect  the  data. 

Allow  contractors  to  establish  standards.  Must  be 
updated. 


EXPERT  OPINION 

Our  discussion  with  the  recognized  expert  centered  around  that 
person's  extensive  experience  in  industry,  academia,  and  as  a  key 
player  for  over  15  years  with  the  American  Society  for  Quality 
Control  (ASQC)  Cost  of  Quality  committee  activities.  The  high¬ 
lights  of  our  discussions  focused  on  the  fact  that  data  has  shown 
what  big  contributions  are  made  by  functional  activities  other 
than  just  the  quality  department  to  a  company's  total  cost  of 
quality.  For  example,  there  is  typically  a  heavy  emphasis  on 
test  activities,  to  verify  or  prove  the  quality  of  the  product. 
Often,  as  much  as  70%  of  the  quality  budget  is  spent  in  test. 
But,  production  operator  inspection  has  been  found  to  be  a  bigger 
cost  than  formal  quality  department  inspections.  Companies  today 
are  doing  everything  they  can  to  reduce  direct  labor  to  aide 


profitability.  With  Proper  use,  cost  ^  quality  would  much 
bigger  dividends .  because  it  attacks  the  entire  organization. 
Direct  labor  is  typically,  although  not  always,  a  fairly  small 
percentage  of  the  total  cost  of  an  item.  The  preferred  base  for 
measuring  cost  of  quality  is  “percent  of  value  added”.  The  most 
important  aspect  of  having  the  cost  of  quality,  other  than  using 
it,  is  the  fact  that  you  now  have  "defined  the  quality  system", 
expressed  in  terms  of  the  cost  of  that  system. 


APPENDIX  C 

PROPOSAL  REVIEW  CHECKLIST 


PROPOSAL  P ;v : zv  checklist 


.  Is  proposed  contractor  effort  YES _  NO 

required  by  SOW? 

2.  Has  the  contractor  interpreted  the 

SOW  tasking  properly?  Yes _  NO 


3.  Should  the  desired  scope  of  the 
SOW  tasking  be  clarified  for  the 

contractor?  YES _  NO 


4.  IS  effort  required  to  produce 

hardware?  *  YES _  NO 


5.  If  not  required  for  production  of 
hardware,  is  effort  required  to 

support  fielded  system?  YES _  NO 


6.  Are  resources  applied  reasonably 

for  task?  YES  NO 


7.  Are  correct  skill  level  personnel 

applied?  YES _  NO 


8.  is  timing  of  effort  and  applied 
resources  consistent  with  build 

schedule?  YES _  NO 


9.  is  effort  or  applied  resources 
redundant  with  any  other  W3S 

element?  YES _  NO 


10.  is  effort  or  applied  resources 

redundant  with  any  prior  contract 

task  element?  YES _  NO 


11.  Is  effort  being  accomolished 

efficiently?  '  YES _  NO 


12.  Oo  the  combined  magnitude  of  hours 
and  interrelationship  between  labor 
categories  appear  reasonable  when 

graphed  together?  YES _  NO 


SAMPLE  AWARD  FEE  EVALUATION  CRITERIA 


FEE  DETERMINATION 
A.  Evaluation  criteria 

The  evaluation  criteria  and  relative  weightings  are  as 
follows: 

1.  Improvement  Goals  -  Achievement  of  quality 
improvement  goals  stated  in  Program  Task  Plans 
(PTP)  based  in  part  on  use  of  cost  of  quality 
data.  (20%) 

2.  Schedules  -  Reasonableness  of  projection  and 
degree  of  achievement  of  the  following  PTP 
milestones  consistent  with  the  statement  of  Work 
priority  system  (10%) . 

a.  Capturing  cost  of  quality 

b.  Dissemination  of  cost  of  quality 

c.  Evidence  of  use  of  cost  of  quality 

d.  Results  of  cost  of  quality  based  improvement 
projects 

3.  Budget  Projection  -  Ability  to  accurately  project 
WBS  3rd  level  budgets  (a  comparison  of  WBS  3rd 
level  budgets  versus  projected  WBS  3rd  level 
EAC's)  (15%). 

4.  Cost  Control  -  Ability  to  control  the  cost  of  the 
total  quality  effort  (cumulative  budget  to  date 
versus  cumulative  actuals  to  date)  (15%) . 

5.  Cost  of  Quality  Management  -  Efficiency/effective¬ 
ness  of  accomplishing  cost  of  quality  objective  in 
support  of  the  program  (15%) . 

6.  Responsiveness  -  Quality/timeliness/completeness/ 
appropriateness  of  the  Contractor's  responsiveness 
to  Government  direction  in  the  cost  of  quality 
area  (15%) . 

7.  Program  Reviews  -  Quality/timeliness/completeness/ 
appropriateness  of  use  of  cost  of  quality 
information  in  reviews  (including  technical, 
management,  and  business  aspects)  (10%) . 


SECTION  H  -  SPECIAL  PROVISIONS 


II.  MANAGEMENT 

Achievement  of  a  Prevention  Emphasis  (Award  Fee  Available:} 


OVERALL  OBJECTIVE:  Aggressive  and  innovative  pursuit  of 

improved  Prevention  Cost  Effectiveness  which  provides 
increased  mission  capability,  better  long-term  readiness, 
and  more  cost-effective  support. 

A.  Management  Awareness  -  Direct  involvement  of  management 
that  demonstrates  their  commitment  to  Prevention  Cost 
Effectiveness  improvements  resulting  from  better  appli¬ 
cation  of  preventative  measures,  which  include: 

o  Thorough  Prevention  planning  that  has  maximum  cost 
effectiveness  as  demonstrated  by  reduced  failure 
costs . 

o  Program  management  support  demonstrated  by  insti¬ 
tuting  program-wide  prevention  policies  that  pro¬ 
mote  improvement  of  Quality,  and  lower  total  cost 
of  Quality. 

B.  Engineering  Analysis  -  Development  of  innovative 
methods  to  assess  Prevention  measures.  Criteria  for 
evaluation  will  include: 

o  Approaches  to  predicting  and  evaluating  potential 
problems  to  support  prevention  planning  and  imple¬ 
mentation 

o  Utilization  of  prevention  techniques  that  enhance 
confidence  in  early  achievement  of  requirements. 


C.  Management  of  Vendors  -  Positive  measures  taken  to 
affect  improvement  of  prevention  of  defective  output 
through  management  of  vendors.  Specific  evaluation 
criteria  are: 

o  Timely  identification  and  resolution  of  problems 
that  arise  in  the  prevention  management  area  of 
cost  of  quality. 

D.  Testing  -  Achievement,  as  rapidly  as  possible,  of 
maturation  of  reliability  in  order  to  maximize  FSD 
mission  success  rate  and  insure  readiness  at  IOC. 


Criteria  for  evaluation  will  include: 

o  Early  completion  of  scheduled  reliability  tests 
that  result  in  early  accomplishment  of  other  tasks 
on  the  program  schedule. 

o  Incorporation  of  prevention  fixes  that  enhance 
weapon  system  performance  and  supportability 
goals. 


III.  TECHNICAL  AND  OPERATIONS  (Award  Fee  Available:) 


OVERALL  OBJECTIVE:  Aggressive,  comprehensive  use  of  cost  of 
quality  as  a  management  tool  during  design,  development, 
manufacturing,  quality  assurance,  subcontract  management, 
and  test  efforts  which  drive  superior  operational  effective¬ 
ness,  system  performance,  and  overall  schedule  accomplish¬ 
ment  without  compromising  cost  and  supportability  objec¬ 
tives. 

A.  Engineering  Management  -  Evaluation  will  focus  on 
design,  development,  and  test  tasks i  Criteria  will 
include: 

o  Problem  Resolution:  Rapid  identification,  through 
use  of  cost  of  quality  information,  of  problems 
and  development  of  thorough  corrective-action 
plans.  Rapid  implementation  of  solutions  that 
optimize  benefits  to  the  overall  weapon  system. 

o  Major  Reviews:  Thorough  planning  and  professional 
execution  of  major  reviews.  Rapid  response  to 
action  items  with  creative  resolution  of  areas 
disagreement. 

o  System  Performance  Validation:  Early  completion 

of  successful  Flight  Worthiness  and  Qualification 
Testing.  Rapid  evaluation  of  flight  test  data  and 
early  validation  of  system  and  component  perfor¬ 
mance  . 


B.  Quality  Assurance  -  Implementing  Quality  Improvement 
Programs  (QIPs)  which  are  based  on  cost  of  quality 
indicators  at  suppliers.  Areas  to  be  evaluated  at 
suppliers  will  include: 

o  Top  level  management  and  commitment  to  improve 
quality,  through  use  of  cost  of  quality. 


o  Annual  improvement  goals  which  are  measured  and 
reported. 

o  Training  and  awareness  programs. 


C.  Manufacturing  Management  -  The  ability  of  manufacturing 
management  organization  to  exceed  expectations  and 
contractual  requirements.  Emphasis  will  be  placed  on 
use  of  cost  of  quality  data  in  the  areas  of: 

o  Management  visibility 

o  Internal  schedule  status 

o  Productivity  and  Quality  Improvement  Programs 

o  Timely  identification  and  resolution  of  production 
risks 


D.  Subcontract  Management  -  The  ability  of  subcontract 
management  organization  to  exceed  Air  Force  expecta¬ 
tions  and  contractual  requirements  in  managing  subcon¬ 
tracts  and  materials  requirements,  particularly  with 
the  critical  subcontractors.  Emphasis  will  be  placed 
on  use  of  cost  of  quality  data  in  the  areas  of: 

o  Management  visibility 

o  Schedule  status 

o  Productivity  and  Quality  Improvement  Programs 

o  Timely  identification  and  resolution  of  production 

risks 


E.  Test  Program  -  Timely,  flexible,  and  substantial  test¬ 
ing  of  the  entire  system,  component  functions,  and 
performance.  The  evaluation  will  be  based  on  use  of 
cost  of  quality  data  as  an  integral  part  of: 

o  Imaginative  and  innovative  efforts  to  effectively 
plan  and  document  the  test  program. 

o  Perceptive  approaches  to  accomplish  test  objec¬ 
tives. 

o  Superior  management  application  of  resources  to 
stay  on  or  ahead  of  schedule. 


IV.  PROGRAM  MANAGEMENT  (Award  Fee  Available:) 


OVERALL  OBJECTIVE:  Efficient,  creative,  and  integrated 
management  approaches  which  stimulate  superior  cost  effec¬ 
tiveness,  enhanced  system  performance,  and  fulfillment  of 
requirements  well  ahead  of  schedule,  through  integration  of 
cost  of  quality  as  a  key  management  tool.  Implementation 
should  be  through  disciplined  management  approaches  employed 
in  a  timely  manner. 

A.  Interface  Management  -  How  thoroughly  and  expeditiously 
the  Contractor  resolves  management  issues  highlighted 
by  cost  of  quality  data.  Items  of  interest  include: 

o  Interface  management  communications. 

o  Adherence  and  adequacy  of  interface  management 
plans. 

o  Functional  implementation  and  reporting  of  inter¬ 

face  efforts. 


B.  Configuration  "Management  -  Operation  in  an  active  man¬ 
agement  mode,  using  innovative  and  creative  methods  to 
identify  potential  trouble  areas  and  resolve  issues 
surfaced  by  cost  of  quality  indicators  before  they 
become  problems.  Items  of  interest  include: 

o  Changes  to  established  baselines. 

o  Configuration  of  each  end  item. 

o  Quality  of  data  to  enhance  the  streamlined  manage¬ 
ment  approach  of  the  _ . 


D.  Schedule  and  Cost  Control  -  Creative  management  action 
that  greatly  improves  schedule  cost  performance  through 
the  use  of  cost  of  quality  data  while  meeting/exceeding 
the  program  schedule  milestones.  Items  of  interest 
include: 

o  Ingenious  plans  to  avoid  potential  cost  overruns 
through  use  of  cost  of  quality  as  an  integral  part 
of  program  cost  management. 

o  Creative  planning  to  meet/exceed  major  scheduled 
program  milestones. 


